-- Logs begin at Thu 2022-09-08 12:50:16 UTC, end at Thu 2022-09-08 14:28:19 UTC. -- Sep 08 13:39:29.355862 dv-cinder-847733-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 13:39:29.371242 dv-cinder-847733-4-smb devstack@keystone.service[93396]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:39:29 2022] *** Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: nodename: dv-cinder-847733-4-smb Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: machine: x86_64 Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: clock source: unix Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: pcre jit disabled Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: detected number of CPU cores: 4 Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: current working directory: / Sep 08 13:39:29.374302 dv-cinder-847733-4-smb devstack@keystone.service[93396]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:39:29.374905 dv-cinder-847733-4-smb devstack@keystone.service[93396]: your processes number limit is 47680 Sep 08 13:39:29.374905 dv-cinder-847733-4-smb devstack@keystone.service[93396]: your memory page size is 4096 bytes Sep 08 13:39:29.374905 dv-cinder-847733-4-smb devstack@keystone.service[93396]: detected max file descriptor number: 2048 Sep 08 13:39:29.374905 dv-cinder-847733-4-smb devstack@keystone.service[93396]: lock engine: pthread robust mutexes Sep 08 13:39:29.374905 dv-cinder-847733-4-smb devstack@keystone.service[93396]: thunder lock: enabled Sep 08 13:39:29.375162 dv-cinder-847733-4-smb devstack@keystone.service[93396]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 13:39:29.375162 dv-cinder-847733-4-smb devstack@keystone.service[93396]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:39:29.419217 dv-cinder-847733-4-smb devstack@keystone.service[93396]: Python main interpreter initialized at 0x5561f85cb9c0 Sep 08 13:39:29.419217 dv-cinder-847733-4-smb devstack@keystone.service[93396]: python threads support enabled Sep 08 13:39:29.419217 dv-cinder-847733-4-smb devstack@keystone.service[93396]: your server socket listen backlog is limited to 100 connections Sep 08 13:39:29.419217 dv-cinder-847733-4-smb devstack@keystone.service[93396]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:39:29.419751 dv-cinder-847733-4-smb devstack@keystone.service[93396]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:39:29.419751 dv-cinder-847733-4-smb devstack@keystone.service[93396]: *** Operational MODE: preforking *** Sep 08 13:39:29.419962 dv-cinder-847733-4-smb devstack@keystone.service[93396]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:39:29.419962 dv-cinder-847733-4-smb devstack@keystone.service[93396]: spawned uWSGI master process (pid: 93396) Sep 08 13:39:29.420249 dv-cinder-847733-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 13:39:29.421515 dv-cinder-847733-4-smb devstack@keystone.service[93396]: spawned uWSGI worker 1 (pid: 93408, cores: 1) Sep 08 13:39:29.421515 dv-cinder-847733-4-smb devstack@keystone.service[93396]: spawned uWSGI worker 2 (pid: 93409, cores: 1) Sep 08 13:39:29.421515 dv-cinder-847733-4-smb devstack@keystone.service[93396]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:39:34.085321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:39:34.085321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: from cryptography.utils import int_from_bytes Sep 08 13:39:34.086213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:39:34.086213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: from cryptography.utils import int_from_bytes Sep 08 13:39:34.138143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:39:34.138414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:39:34.138540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] command line args: [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:39:34.138772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:39:34.138952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ================================================================================ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:39:34.139208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] admin_token = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.139457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_dir = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.139647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.139838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] config_source = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.140021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] debug = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.140246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.140612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.140801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.141057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.141308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.141543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.141724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_config_append = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.141905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.142084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_dir = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.142243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.142478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.142733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.142984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.143236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.143454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.144135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.144416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.144665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.144904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.145180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.145377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.145623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.145865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.146112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.146391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.146897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.147082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] publish_errors = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.147315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.147548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.147724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.147982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.148241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.148469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] standard_threads = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.148702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.148946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.149124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.149304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_journal = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.149484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_json = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.149660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_stderr = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.149843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] use_syslog = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.150076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.150339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.150579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.150841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.151081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.151332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.151570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.151820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.152058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.152339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.152586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.152842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.153079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.153328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.153567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.153815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.154064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.154304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.154560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.154816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.155066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.155317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.155588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.155855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.156110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.156387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.156629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.156864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.157104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.157336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.157596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.157846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.158077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.158310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.158559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.158808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.159079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.159328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.159564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.159809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.160048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.160308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.160532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.160757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.160989 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.161227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.161480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.161712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.161950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.162181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.162417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.162654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.162904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.163137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.163375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.163616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.163852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.164090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.164352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.164586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.164837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.165074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.165315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.165549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.165815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.166054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.166287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.166526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.166766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.167043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.167284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.167534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.167784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.168032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.168295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.168535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.168784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.169026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.169265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.169510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.169753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.170004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.170243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.170481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.170720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.170958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.171195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.171481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.171714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.171961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.172231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.172465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.172760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.173002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.173242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.173481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.173714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.173948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.174183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.174423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.174786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.174961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.175202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.175457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.175700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.175959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.176296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.176501 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.176827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.external = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.176969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.177270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.177511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.177747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.password = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.177981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] auth.token = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.178223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.178464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.178716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.178949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.179200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.179450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.179687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.179930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.180180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.180543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.180711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.180957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.181205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.181443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.181692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.182153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.182328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.182487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.182712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.182964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.183246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.183473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.183733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.183971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.184234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.184488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.184740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.184973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.185235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.185465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.185724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.185962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.186220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.186458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.186721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.186947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.187197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.187449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.187686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.187923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.188173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.188431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.188675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.188927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.189184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.189420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.189654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.189892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.190677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.190938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.191189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.191448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.191698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.191971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.192251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.192472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.192707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.192946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.193180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.193417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.193665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.193909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.194162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.194403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.194651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.194902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.195142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.195392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.195642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.195879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.196120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.196379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.196621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.196950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.197112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.197355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.197746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.198003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.198256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.198492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.198728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.198982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.199254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.199472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.199711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.199951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.200185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.200460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.200726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.200963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.201216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.201469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.201720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.201959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.202193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.202431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.202669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.202913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.203146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.203396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.203648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.203896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.204145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.204422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.204658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.204909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.205151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.205389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.205629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.205969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.206686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.206938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.207177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.207434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.207669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.207918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.208157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.208444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.208685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.208936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.209182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.209418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.209659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.209902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.210157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.210414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.210654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.210906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.211161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.211456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.211649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.211887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.212127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.212389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.212895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.213128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.213382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.213632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.213883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.214132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.214397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.214626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.214876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.215124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.215359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.215607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.215857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.216105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.216378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.216817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.217054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.217307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.217558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.217809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.218060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.218296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.218556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.218808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.219047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.219282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.219516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.219753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.220001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.220293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.220547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.220786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.221023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.221255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.221525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.221765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.222015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.222254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.222514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.222763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.223004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.223250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.223496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.223746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.223985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.224280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.224489 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.224739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.225024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.225259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.225511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.225763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.226024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.226271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.226521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.226761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.227004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.227243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.227482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.227720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.227957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.228226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.228469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.228718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.228957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.229208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.229447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.229693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.229924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.230165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.230407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.230565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:39:34.261959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.273066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.273066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.282330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.314012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.314266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.387204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.448128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.448415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.456298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:39:34.456298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: from cryptography.utils import int_from_bytes Sep 08 13:39:34.456905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:39:34.456905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: from cryptography.utils import int_from_bytes Sep 08 13:39:34.507265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:39:34.507492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:39:34.507690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] command line args: [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:39:34.507896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:39:34.508076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ================================================================================ {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:39:34.508368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] admin_token = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.508625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] config_dir = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.508817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.509001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] config_source = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.509195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] debug = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.509390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.509642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.509822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.510085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.510337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.510575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.510759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_config_append = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.510940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.511121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_dir = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.511301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_file = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.511545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.511798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.512047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.512335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.512540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.512679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.512934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.513184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.513423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.513659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.513897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.514187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.514581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.514738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.515058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.515506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.96/identity {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.515690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] publish_errors = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.515958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.516196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.516405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.516656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.516894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.517134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] standard_threads = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.517369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.517616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.517797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.517976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] use_journal = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.518156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] use_json = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.518366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] use_stderr = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.518545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] use_syslog = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.518785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:39:34.519050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.519294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.519562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.519806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.520100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.520465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.520633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.524525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.525583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.526528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.527872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.528110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.528383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.528641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.528875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.529110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.529344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.529578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.529822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.530079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.530314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.530554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.530788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.531029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.531379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.531641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.531873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.532115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.532410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.532652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.532893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.533133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.533366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.533623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.533931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.534267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.534523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.534794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.535098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.535337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.535577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.535820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.536096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.536390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.536697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.537000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.537246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.537516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.537778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.538035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.538279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.538521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.538773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.539011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.539406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.539609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.539789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.540093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.540369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.540605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.540882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.541128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.541379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.541625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.541866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.542112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.542353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.542593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.542833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.543253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.543483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.543708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.543949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.544186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.544462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.544702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.544962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.545212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.545475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.545745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.545993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.546230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.external = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.546467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.546769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.547009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.547242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.password = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.547606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] auth.token = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.547856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.548100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.548478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.548717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.548972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.549226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.549461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.550224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.550580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.550825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.551080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.551365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.551592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.551833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.552084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.552372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.552617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.552875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.553166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.553419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.553686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.553952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.554194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.554434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.554676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.554925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.555176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.555412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.555663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.555912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.556171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.556442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.556702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.556943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.557193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.557434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.557687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.557938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.558178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.558416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.559820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.560170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.560481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.560709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.560969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.561219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.561479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.561731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.562013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.562256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.562497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.562732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.565966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.568385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.575592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.576616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.577643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.578551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.579477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.580669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.581608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.581608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.581608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.581608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.581608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] role.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.582119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] role.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.582119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.582325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.582502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.582756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.583013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.583266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.583516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.583768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.584018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.584284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.584538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.584792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.585045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.585296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.585741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.585987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.586242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.586497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.586749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.587025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.587246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.587762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.588017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.588289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.588529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.588771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.589001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.589254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.589515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.589767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.590009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.590249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.590487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.590729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.590972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.591222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.591462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.591721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.591974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.592264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.592492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.592739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.592990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.593228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.593470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.593707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.593955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.594246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.594513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.594725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.594996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.595263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.connection = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.595511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.595770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.596010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.596292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.596694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.596938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.597179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.597419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.597669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.597908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.598154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.598394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.598646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.598887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.599137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.599372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.599617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.599857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:39:34.600031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:39:34.626546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.626849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.626985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.636588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.636809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.636809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.637150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.637404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.637556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.637755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.655811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.656126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.662610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.662886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.663031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.663287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.663437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.663658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.663872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.676464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.689947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.690205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.690446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.690775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.691434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.691573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.691758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.696966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.709407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.709699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:39:34.709946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.710144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:39:34.710419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.710718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.710944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.711266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.721803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.722096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.722374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.722662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.729997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.732934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.733222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.733513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.733689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.733825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.733909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.734069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.734343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.734608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.734887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.735158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.735432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.735702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.760797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.762455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.762754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.767668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.767964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.768359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.775015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.775333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.781910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.782226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.782524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.782821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.783101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.783383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.783658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.784478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.801634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.801939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.806222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.809897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.810217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.814728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.818134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.821556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.821874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.822160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.822450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.822735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.823018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.840024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.840356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.840629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.840893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.849036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.850643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.852174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.852490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.855755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.856052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.856372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.856648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.857065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.869244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.869540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.869826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.870108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.870502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.870779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.871067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.878716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.878951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.879166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.879387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.879613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.879830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.887249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.890396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.893406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.894951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.896520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.896812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.896948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.897067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.897067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.897288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.897413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.897565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.897810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.898042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.903720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.905333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.906863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.908333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.908748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.909605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.909883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.910766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.910996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.911220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.911442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.911660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.911880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.912098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:39:34.917686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.917998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.918286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.922590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.922800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:39:34.923145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.923358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:39:34.923646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.923913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.924174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.924498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.925919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.926175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.926458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.926731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.927001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.927272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.927586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.927830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.928098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.928406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.928679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.928950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.929216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.929542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.934979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.935280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.935557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.935846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.943270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.946262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.946553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.946841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.947203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.947493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.947763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.948037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.948347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.948724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.948998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.949276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.968791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561f85cb9c0 pid: 93408 (default app) Sep 08 13:39:34.972485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.972677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057687-bc25-40ff-b831-e281c952d53e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:34.972798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057687-bc25-40ff-b831-e281c952d53e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:34.973058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d057687-bc25-40ff-b831-e281c952d53e None None] PATH_INFO: `/v3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:34.974015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.974313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.978101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 791 bytes} [Thu Sep 8 13:39:34 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:34.979726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.980615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.980920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.988828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.989139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.993366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:34.993673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.993999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.994357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.994673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.997034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.997329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:34.997645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.014038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.014348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.018417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.021693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.022013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.027120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.043654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.044316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.053784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.054100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.054380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.054641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.061870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.063616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.065365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.065656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.068414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.068716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.069005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.069308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.069605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.081345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.082747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.082747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.082747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.082747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.082747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.083802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.100607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.104027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.107285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.108846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.110361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.110649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.110950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.121750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.123283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.126236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.126540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.126831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.127123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.135595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.135913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.136220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.144293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:39:35.144503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.144793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.145376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.145855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.146148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.146419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.146872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.147351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.147638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.147926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.148271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.148524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.148809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:39:35.184117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5561f85cb9c0 pid: 93409 (default app) Sep 08 13:39:43.726248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:43.726839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:43.726839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:43.728154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 2/2] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:43.742298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:43.742891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:43.743270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:43.886107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: INFO dbcounter [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] Registered counter for database keystone Sep 08 13:39:43.924120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG oslo_db.sqlalchemy.engines [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:39:43.934865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writer thread running {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:39:44.258477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG passlib.handlers.bcrypt [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93409) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:39:44.258879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG passlib.handlers.bcrypt [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93409) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:39:44.320694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:44.322353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:44.480622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1/3] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 745 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 13:39:45.100684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.172940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: INFO dbcounter [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] Registered counter for database keystone Sep 08 13:39:45.194645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG oslo_db.sqlalchemy.engines [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:39:45.201936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writer thread running {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:39:45.327538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ecd1a-b3cf-464b-8b2d-653071f1496e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:45.332634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:45.333305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:45.333588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:45.333860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:45.343654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:45.396504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:39:45.396748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7f42d-9548-4ffe-b760-0da3f7182a6f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:45.407636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 3/4] 10.222.0.96 () {58 vars in 1324 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:39:45.417857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.446480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b165e-e70c-4078-997e-4402f73e2e0c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:45.453931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:45.456614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:45.457109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:45.457589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] PATH_INFO: `/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:45.460529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a4c439d9e4fb8b5b20ab81fd61ef3)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:45.570505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING keystone.common.rbac_enforcer.enforcer [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:39:45.571099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00459a63-1a05-4542-bbdd-cfc6e87ad488 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:45.582922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 2/5] 10.222.0.96 () {56 vars in 1207 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:47.849878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d3d90-94b4-406f-81bc-cedddf97b8bc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:47.850384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d3d90-94b4-406f-81bc-cedddf97b8bc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:47.850750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d3d90-94b4-406f-81bc-cedddf97b8bc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:47.857287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 4/6] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:47.867222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:47.867738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:47.868112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:47.902208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:47.905142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:47.916036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 3/7] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 13:39:48.193360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d3d90-94b4-406f-81bc-cedddf97b8bc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:48.206552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d3d90-94b4-406f-81bc-cedddf97b8bc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:48.210985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:48.211709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:48.211992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:48.212553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:48.221674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:48.223521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400aeb6e-9665-4909-b5e3-9a9af2282dc1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:48.233978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 5/8] 10.222.0.96 () {58 vars in 1324 bytes} [Thu Sep 8 13:39:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:39:48.240646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:48.250281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88eeae-2b84-4158-8145-c8fc2b3143ee None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:48.255404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:48.256145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:48.256493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:48.256799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:48.258217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:48.260230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa4008-f31a-463f-b6ee-4c48368fa44b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:48.261882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 4/9] 10.222.0.96 () {56 vars in 1198 bytes} [Thu Sep 8 13:39:48 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:50.614245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e10e-6a03-4b49-9f7a-198815b05adc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:50.614831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e10e-6a03-4b49-9f7a-198815b05adc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:50.615164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38e10e-6a03-4b49-9f7a-198815b05adc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:50.617385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 6/10] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:50.624553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72de40-6d7a-4f7e-aef9-143e31fcb5be None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:50.625074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72de40-6d7a-4f7e-aef9-143e31fcb5be None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:50.625476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72de40-6d7a-4f7e-aef9-143e31fcb5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:50.657002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7e72de40-6d7a-4f7e-aef9-143e31fcb5be None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:50.659541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7e72de40-6d7a-4f7e-aef9-143e31fcb5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:50.804284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 5/11] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:50.844478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54ee-95dc-435f-a610-4ee888973bd6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:50.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54ee-95dc-435f-a610-4ee888973bd6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:50.845493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c54ee-95dc-435f-a610-4ee888973bd6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:50.848137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 7/12] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:50.856690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:50.856979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:50.857451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:50.879510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:50.885625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:50.903911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:50.980164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 6/13] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:51.075389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c54ee-95dc-435f-a610-4ee888973bd6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.252567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c54ee-95dc-435f-a610-4ee888973bd6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.268298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.300218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:51.301125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.301409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.301692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.317801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:51.339205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:51.340168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:51.341102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:39:51.341699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 8/14] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:51.350373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.395930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:51.410268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228d1ca-ecbf-4e6c-9aaf-d301f50bef39 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.467614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:51.468393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.468748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.469183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.491430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f0cce-c662-4875-a6b6-a269acd53577 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.497215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:51.553430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:51.554431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.554885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.555338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.556607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:51.557123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:51.561868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:51.584490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 9/15] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:51.590101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.593775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:51.595599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:51.717463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:51.725919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d92f4-680e-43ce-9448-d120139c1da8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.732153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 7/16] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:51.740651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.773443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:51.774481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.774924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.775378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.778047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:51.780729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:51.783491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 10/17] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:51.792551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:51.823800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:51.897380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514fe55-d98e-48cd-824d-1db268b923a4 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.949321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:51.950747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.951190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.951508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfddffd-acba-45a6-925e-46c7c377c70c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:51.951640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.969604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:51.971593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:51.993457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:51.995205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:51.996385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:51.996385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:51.996385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:39:51.996385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 8/18] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:52.004172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:52.007206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:52.008197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:52.008709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:52.009155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:52.011181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:52.013280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:52.020306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 11/19] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:52.023770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:52.078445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:52.159909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c87c85-fb6c-4b35-b7b2-01d5f2544df0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:52.164901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:52.172328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb30ed6-3323-425c-bfb8-620948bd9399 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:52.201015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:52.202166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:52.202738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:52.203114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:52.203926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:52.204382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:52.205984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d919-c0b1-4d93-8ea5-4e4945359eef None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:52.226497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:52.227120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:52.227401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:52.227677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:52.228466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.domain.id=default, user.id=1dee14b5375a4327b3046a21c8c67366) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:52.228776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:52.230265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08901b3a-16c7-43c9-89b3-eedec8cf54b7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:52.240968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 9/20] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:52.241251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 12/21] 10.222.0.96 () {56 vars in 1322 bytes} [Thu Sep 8 13:39:52 2022] GET /identity/v3/role_assignments?user.id=1dee14b5375a4327b3046a21c8c67366&scope.domain.id=default&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 233 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:54.685253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7733-d6bb-4428-baf3-6995419797e4 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:54.686001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7733-d6bb-4428-baf3-6995419797e4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:54.686001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7733-d6bb-4428-baf3-6995419797e4 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:54.687200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 10/22] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:54.693404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:54.694355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:54.694932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:54.724067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG passlib.handlers.bcrypt [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=93408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:39:54.724883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG passlib.handlers.bcrypt [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:39:54.781097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:54.783684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:54.918448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 13/23] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:39:55.393527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7733-d6bb-4428-baf3-6995419797e4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:55.540230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7733-d6bb-4428-baf3-6995419797e4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:55.594776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:55.595501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:55.595773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:55.596045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:55.621461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:55.629017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:55.631192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:39:55.633174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 11/24] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:55.639320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:55.685001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:55.777367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e18ff7-4c28-4f9a-8f58-991f04a81268 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:55.820471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:55.821388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:55.821679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:55.821945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:55.822828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:55.823136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:55.824756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:55.835336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 14/25] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:55.843855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:55.878599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:55.993269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edd377-aa17-4e07-8972-81ceaf26fda0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:56.041413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:56.042073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.042430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.042714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.049734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:56.051238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:56.053054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 12/26] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:39:55 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:56.061459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:56.196864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:56.210985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b986a7-a8d2-4ead-9225-7487c10d2af0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:56.256139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:56.256841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.257123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.257406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.258879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:56.260416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1ff03-870d-4fc2-a64c-238f777713ba None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:56.262461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 15/27] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:56.271158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:56.405615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:56.416507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd0ef6d-c7fc-4382-b57e-0b95083c652f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:56.465835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:56.466535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.466829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.467107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] PATH_INFO: `/v3/domains/default/users/1dee14b5375a4327b3046a21c8c67366/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.473487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1dee14b5375a4327b3046a21c8c67366, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:56.475045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652a196-ef94-44ec-b411-e53dfadec162 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:56.544884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68000-8cc3-4ea7-be88-86411a9e13a7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.545126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68000-8cc3-4ea7-be88-86411a9e13a7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.545485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd68000-8cc3-4ea7-be88-86411a9e13a7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.546889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 16/28] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:56.553927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0773709-9fe0-40e8-8c57-968e62f81d09 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.554211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0773709-9fe0-40e8-8c57-968e62f81d09 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.554709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0773709-9fe0-40e8-8c57-968e62f81d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.584143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b0773709-9fe0-40e8-8c57-968e62f81d09 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:56.596100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b0773709-9fe0-40e8-8c57-968e62f81d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:56.712509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 17/29] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:39:56.819219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 13/30] 10.222.0.96 () {58 vars in 1361 bytes} [Thu Sep 8 13:39:56 2022] PUT /identity/v3/domains/default/users/1dee14b5375a4327b3046a21c8c67366/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:39:57.221877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3577b-5409-4265-9f61-d8be0b3057f2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:57.222883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3577b-5409-4265-9f61-d8be0b3057f2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:57.223389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3577b-5409-4265-9f61-d8be0b3057f2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:57.225244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 18/31] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:57.232843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:57.234118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:57.234794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:57.269682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:57.271978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:57.319256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac026f-1d2f-41f6-a6eb-db7629b22e82 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:57.319939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac026f-1d2f-41f6-a6eb-db7629b22e82 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:57.320448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac026f-1d2f-41f6-a6eb-db7629b22e82 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:57.322170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 19/32] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:57.333052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:57.333756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:57.334278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:57.369420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:57.371056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:57.417529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 14/33] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:39:57.420729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:57.509449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 20/34] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:39:57.610719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:57.659442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7352afb-dac3-4f65-9748-7879a0fac424 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:57.754120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:57.755216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:57.755689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:57.756183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:57.783534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:57.786674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:57.824773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:57.826528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:57.828934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:57.828934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:57.828934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:39:57.828934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 15/35] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:57.839978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:57.891193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:58.070430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:58.111066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b3c9d-22e3-4d54-a868-3a0ecbccc24c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:58.221310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:58.221953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.222776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.222776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.223170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:58.226776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:58.226776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:58.279245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 21/36] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:58.280118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:58.301409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb4c42-79ae-461d-9100-5cdaa47b3ed7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:58.365163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:58.365704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.365989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.366263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.366998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:58.368698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:58.377274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:58.472877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:58.492918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 16/37] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Sep 8 13:39:58 2022] POST /identity/v3/roles => generated 225 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:39:58.493826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:58.522102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f92e63-384d-4ddb-b5f6-8d8ca864a90b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:58.621601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:58.622560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.623061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.623549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.624872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:58.627596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07cf42-8403-443f-9123-60538d4bbcbc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:58.681407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec5693-f21a-451a-a19b-af1c861f6a89 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:58.827810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:58.830345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.831205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.831945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.833525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:58.836941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1885fa11-a551-451e-a130-a3b6af0110c3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:58.969999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 17/38] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:39:58 2022] POST /identity/v3/projects => generated 301 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:39:58.972398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291e59-973b-4299-9cea-46260472eae0 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.972958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291e59-973b-4299-9cea-46260472eae0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.973879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9291e59-973b-4299-9cea-46260472eae0 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.976898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 18/39] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:58.979569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ea65-d0ec-4c85-a67a-5d356fa25e81 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.982571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ea65-d0ec-4c85-a67a-5d356fa25e81 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.982571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ea65-d0ec-4c85-a67a-5d356fa25e81 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:58.988853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 19/40] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:39:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:58.991019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:58.991554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:58.992019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:59.004338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 22/41] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Sep 8 13:39:58 2022] POST /identity/v3/roles => generated 219 bytes in 717 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:39:59.007419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:59.007909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:59.008428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:59.038577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:59.041160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:59.050794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:59.053790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:59.331606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 23/42] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:59.370941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:59.428990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 20/43] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:59.777559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:59.858084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:59.869906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:59.926066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4f208-eb0a-40aa-bc13-338df3988d60 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:59.974752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:59.975577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:59.976056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:59.976585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:59.978264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:59.980302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:59.981996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 24/44] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:59.987581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:00.034747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc088fc-d137-4a6a-aded-c077498c910b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:00.094014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:00.094677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.094947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.096059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.097981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:00.098409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331431fe-ce33-4bd7-8477-9c2f66e14bb9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:00.111609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5b5b2-37f5-432f-843c-b851f2ad81f4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:00.149423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:00.150053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.150340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.150618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.151308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:00.152969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:00.159407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:00.210164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 21/45] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Sep 8 13:39:59 2022] POST /identity/v3/roles => generated 223 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:40:00.211498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c68a7-b4b2-4bdc-b252-9a7fbfbce6f5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.211795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c68a7-b4b2-4bdc-b252-9a7fbfbce6f5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.212083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c68a7-b4b2-4bdc-b252-9a7fbfbce6f5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.213688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 22/46] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:00.221077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.221457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.221798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.243676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:00.244994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:00.281323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:00.310932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 25/47] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:39:59 2022] POST /identity/v3/projects => generated 312 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:40:00.336324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 23/48] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:00.618202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:00.763553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbecd-363e-44f4-b5ac-424f9646a1cd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:00.807202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:00.807863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.808150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.808469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.821580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:00.826652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:00.828008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:00.829604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 26/49] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:00.837481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:00.961073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639b252-ed4d-49e3-a8b3-3e349dd0754b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.003827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.004574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.004970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.005331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.006103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:01.006597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.008089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.022119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 24/50] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:01.028867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:01.089024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:01.152493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822035-e466-4d43-a1ae-ac2c2356c068 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.322234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.323366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.323878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.324425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.327183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.330159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.333445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 27/51] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:01 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:01.340475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:01.394487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:01.532445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc5049-7c10-4eb8-85a0-0505d342cac1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.594963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.596553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.597063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.597543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.599603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.602459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cafbd3-71a8-449c-b0e7-4941736e6230 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.610336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 25/52] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:01.611694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:01.732434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce06f30-426c-479e-aaeb-4602c68b76d1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.748406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:01.771237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.771871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.772158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.772473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.773262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.domain.id=default, user.id=1dee14b5375a4327b3046a21c8c67366) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:01.773615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.775109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fccc867-be1f-429a-949b-09a40528f878 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.782834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 28/53] 10.222.0.96 () {56 vars in 1322 bytes} [Thu Sep 8 13:40:01 2022] GET /identity/v3/role_assignments?user.id=1dee14b5375a4327b3046a21c8c67366&scope.domain.id=default&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 530 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:02.665243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca783d-8811-48bb-b3b7-ce690199f7dc None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:02.666071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca783d-8811-48bb-b3b7-ce690199f7dc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:02.666071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca783d-8811-48bb-b3b7-ce690199f7dc None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:02.667364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 26/54] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:02.674222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:02.674508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:02.674788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:02.694932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:02.696403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:02.776845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 29/55] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:03.052611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca783d-8811-48bb-b3b7-ce690199f7dc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:03.165916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:03.173599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca783d-8811-48bb-b3b7-ce690199f7dc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:03.221436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:03.222411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:03.222910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:03.223406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:03.225823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:03.227397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdcb8b-9a77-4b32-9e66-c1992e08947d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:03.229238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 27/56] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:03.235251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:03.362608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de712ce-440f-4f6d-bede-ac49d65a3d1f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:03.374400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:03.402109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:03.402877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:03.403214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:03.403535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:03.404301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:03.405976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e0f56-504f-4c91-9592-04a4483c1baa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:03.528505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 30/57] 10.222.0.96 () {60 vars in 1140 bytes} [Thu Sep 8 13:40:03 2022] POST /identity/v3/projects => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:40:05.826428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5801c-5038-4582-8774-acdebf84cc6e None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:05.826981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5801c-5038-4582-8774-acdebf84cc6e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:05.826981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb5801c-5038-4582-8774-acdebf84cc6e None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:05.828546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 28/58] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:05.834346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:05.834881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:05.834881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:05.856736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:05.861486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:05.939036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 31/59] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:06.219314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5801c-5038-4582-8774-acdebf84cc6e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:06.339172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb5801c-5038-4582-8774-acdebf84cc6e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:06.378443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:06.379099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:06.379384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:06.379659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:06.380887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:06.382408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6a1ba-d159-4e28-b87f-595b3f487321 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:06.384113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 29/60] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:06.392928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:06.500239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:06.510244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebb67b-c44c-4068-9bcc-7331431f624a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:06.549615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:06.550378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:06.550695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:06.550946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:06.551632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:06.553157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37b31-5716-4ca8-96a5-d1fbd113e7d0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:06.648532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 32/61] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:06 2022] POST /identity/v3/users => generated 275 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:10.680274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9faf1d-3e04-47ea-9011-ceb1aa9282b7 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.680274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9faf1d-3e04-47ea-9011-ceb1aa9282b7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.680274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9faf1d-3e04-47ea-9011-ceb1aa9282b7 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.684352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 30/62] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:10.691860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832aee-6a5e-48b7-8a13-92ff0098ab16 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.692794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832aee-6a5e-48b7-8a13-92ff0098ab16 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.692794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3832aee-6a5e-48b7-8a13-92ff0098ab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.712589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13722-68df-4585-8ffa-426531ac3f2f None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.713528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13722-68df-4585-8ffa-426531ac3f2f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.714387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee13722-68df-4585-8ffa-426531ac3f2f None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.717451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 31/63] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:10.723030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d3832aee-6a5e-48b7-8a13-92ff0098ab16 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:10.724791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d3832aee-6a5e-48b7-8a13-92ff0098ab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:10.727247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.728023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.728780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.777413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:10.779533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:10.836021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:10.927400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 33/64] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:10.929049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53500c-634e-4f2c-ae67-769438acf023 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.929521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53500c-634e-4f2c-ae67-769438acf023 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.929946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53500c-634e-4f2c-ae67-769438acf023 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.931788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 34/65] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:10.938772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:10.939511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:10.941382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:10.980758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:10.982375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:10.983387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 32/66] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:11.161893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 35/67] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:11.308160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:11.466586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222843b8-ef4b-4617-bd29-1aa515304692 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:11.472710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:11.496232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:11.519198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:11.520268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:11.521241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:11.521742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:11.539083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:11.546387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:11.547316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:11.548125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:11.556533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 33/68] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:11.562913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:11.635531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:11.659968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72740b34-6a50-4c6d-8942-c629cc6c6367 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:11.708431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:11.710049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:11.710560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:11.711114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:11.726165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:11.732140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:11.733088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:11.733845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:11.736999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 36/69] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:11.738254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:11.807380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88980ef5-35ae-4d2d-b1f8-719751df6c38 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:11.841770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:11.845424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:11.846060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:11.846346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:11.846615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:11.847305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:11.847613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:11.849162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:11.858520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 34/70] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:11.860651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:11.897227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb9baf-8df9-414e-8844-556bc829f799 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:11.958983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:11.960464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:11.960970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:11.961481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:11.965637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:11.981172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:11.986142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bafb2-15e6-4644-8dae-ba57caa77837 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6cdbe5f7-384b-419a-a987-31810edb567a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:11.986395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:11.987985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:11.989062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:11.994240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 37/71] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:11.997123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4c63-6e3b-4ad0-969c-83c95a03e62f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:11.997646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4c63-6e3b-4ad0-969c-83c95a03e62f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:11.998163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf4c63-6e3b-4ad0-969c-83c95a03e62f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.001814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 38/72] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:12.003727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4c63-6e3b-4ad0-969c-83c95a03e62f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.038469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.039117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.039417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.039689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.040442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:12.040755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.042190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.051853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 35/73] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:12.052590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.173726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4f026-bf3a-49ee-a1a0-f7d585d82f1a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:12.206757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf4c63-6e3b-4ad0-969c-83c95a03e62f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:12.213050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.213692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.213973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.214352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.215050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:12.215355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.216819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725971b-c0be-43dc-80ca-2ea3b97bd0f1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.227121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 36/74] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:12.228443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf775-b519-438d-a8cb-08033f4b5289 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.228753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf775-b519-438d-a8cb-08033f4b5289 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.229002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcf775-b519-438d-a8cb-08033f4b5289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.254857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e2bcf775-b519-438d-a8cb-08033f4b5289 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:12.256839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e2bcf775-b519-438d-a8cb-08033f4b5289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:12.257959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:12.261485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:12.270706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.271606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.284448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.284448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.293079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.294536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.296888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 39/75] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:12.298039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.348863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 37/76] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:12.351040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93465-5daf-4d7b-9485-df4922a61bfd None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.351529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93465-5daf-4d7b-9485-df4922a61bfd None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.352012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93465-5daf-4d7b-9485-df4922a61bfd None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.354597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 38/77] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:12.356063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d93465-5daf-4d7b-9485-df4922a61bfd None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.473997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782a8d3-b0f9-4214-b048-b869e1f58e17 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:12.538257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.539526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.540308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.541061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.543424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.545208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d93465-5daf-4d7b-9485-df4922a61bfd None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:12.546746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.550120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 40/78] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:12.551952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.621470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.622537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.623044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.623548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.625865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.629345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d34446-0864-437b-81ca-48e1b1d02b51 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.632782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 39/79] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:12.634523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:12.638018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.638465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.638875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.656420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:12.664388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:12.665751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:12.701941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a408-f4b6-4da4-9708-e45a0150c292 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:12.754066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:12.755040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:12.755421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:12.755787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:12.759398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 40/80] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:12.761226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:12.881261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:12.883750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:12.966178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:12.974015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a474e59-1e97-4976-bd87-04a7a431d61e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.033304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.034470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.034921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.035375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.041196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.054077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 41/81] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:13.055577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.151247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.152706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.192059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b04ef3-1605-404d-babc-6f32e6dfcc20 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.236046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.237031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.237494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.237950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.254172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:13.259281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:13.261254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:13.262826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:13.265617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 42/82] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:13.266504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.280912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 41/83] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:13.281813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.287064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.331089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.409271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee5cca-2e77-43c4-8499-295c021c72da None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.434119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790c0fc-6663-4655-b745-6e02bfc3ddf3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.457014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.458030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.458524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.459016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.476517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.477350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.477700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.478049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.479570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.481266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.483070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 42/84] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:13.483899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.555369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.557079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.574233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.625934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb378e6-963f-42cf-bcd5-c17c96ef6a26 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.630141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.668284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.668865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.669164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.669443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.670762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.672378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.674721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 43/85] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:13.677230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.707774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 43/86] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:13.709967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.800227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29259140-4387-4ddc-95fe-db72f8a2fcd4 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.842953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.843955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.844501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.845505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.846787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:13.847363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.850233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.866619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 44/87] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:13.868165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.870973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185a299-7834-45fb-9422-ac83546ce9a9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:13.887708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:13.911980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:13.912675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:13.912958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:13.913240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:13.914534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:13.916081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:13.917861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 44/88] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:13.918741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:13.936672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:14.022420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080d09-b9e3-4068-a97e-cc056b24d71d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.071446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.072092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.072468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.072604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4900-df08-4cb2-93b2-99ddf77d2f73 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.072863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.073608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.075540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.125441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.126964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.127452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.127945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.129343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:14.129898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.132772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.143999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 45/89] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:13 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=fd19870371784c8facf151d36c77a6b5 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:14.145653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:14.196779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 45/90] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:13 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:14.198234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:14.265077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:14.394598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be65f0d-148f-467e-93f8-1395b3f710b1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.422298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:14.450531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164f455-5baa-422c-871f-ed0e39e8f473 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.476620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.476620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.476620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.476620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.478270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.480808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.488512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 46/91] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:14 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:14.488512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:14.533694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.533962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.534322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.534795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.537725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.540944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.544557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 46/92] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:14 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:14.548993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:14.710456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f1194-bbb5-47ac-8bb5-c4b6bde4a886 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.732572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:14.763411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.764053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.764390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.764680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.765449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:14.765765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.767321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.775928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 47/93] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:14 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=21008fb2299d4f8cba069e6c99468411 => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:14.777198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:14.779562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2441d2-d4c8-49a4-82da-4612ed3a2855 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:14.849327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:14.850355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:14.850859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:14.851358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:14.852734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=1dee14b5375a4327b3046a21c8c67366) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:14.853236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:14.855967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:14.870581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 47/94] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:14 2022] GET /identity/v3/role_assignments?user.id=1dee14b5375a4327b3046a21c8c67366&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:14.953511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7865576-3880-4255-aafc-e576e3d53d4e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:15.004517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:15.005068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:15.005359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:15.005637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:15.080841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:15.129742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:15.132403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:15.361032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 48/95] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:15.371188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:15.425656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:15.629179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f41d8-4349-480f-ad9c-973cb2093e5d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:15.722611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:15.723860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:15.724431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:15.724951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] PATH_INFO: `/v3/projects/993460ab4c67460aa69001511da372d6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:15.729657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] RBAC: Authorizing `identity:get_project(project_id=993460ab4c67460aa69001511da372d6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:15.732611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399353-c06a-4e08-833a-1f6b0fed388b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:15.736933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 48/96] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:15 2022] GET /identity/v3/projects/993460ab4c67460aa69001511da372d6 => generated 312 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:15.747046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:15.877506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:15.909068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a079e-4025-4d69-a553-b5455b7b59ab None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:15.956487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:15.957493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:15.957493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:15.957730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:15.958414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=993460ab4c67460aa69001511da372d6, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:15.958735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:15.960265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c38ed-5062-481a-bfc4-69aac07d3a95 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:15.970785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 49/97] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:15 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=993460ab4c67460aa69001511da372d6&role.id=fd19870371784c8facf151d36c77a6b5 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:18.488921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8e6b-a6fc-4b14-961c-816949bccf06 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:18.489965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8e6b-a6fc-4b14-961c-816949bccf06 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:18.490457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8e6b-a6fc-4b14-961c-816949bccf06 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:18.492130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 49/98] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:18.497722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156114a3-eb96-4095-8bf9-bf763e0d2d70 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:18.499106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156114a3-eb96-4095-8bf9-bf763e0d2d70 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:18.499767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156114a3-eb96-4095-8bf9-bf763e0d2d70 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:18.502844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 50/99] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:18.510063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be40e94-36cf-4a21-8d6f-2177985ed900 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:18.511052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be40e94-36cf-4a21-8d6f-2177985ed900 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:18.511834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be40e94-36cf-4a21-8d6f-2177985ed900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:18.522357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959983e-38f4-4069-a5d5-5ab2eec3c9fa None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:18.524471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959983e-38f4-4069-a5d5-5ab2eec3c9fa None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:18.527615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959983e-38f4-4069-a5d5-5ab2eec3c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:18.566182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0be40e94-36cf-4a21-8d6f-2177985ed900 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:18.572234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0be40e94-36cf-4a21-8d6f-2177985ed900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:18.589451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9959983e-38f4-4069-a5d5-5ab2eec3c9fa None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:18.591850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9959983e-38f4-4069-a5d5-5ab2eec3c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:18.711689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 50/100] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:18.752735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 51/101] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:19.039428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46299-f8ec-4397-be33-44c1e799b1e1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.040182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46299-f8ec-4397-be33-44c1e799b1e1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.040783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb46299-f8ec-4397-be33-44c1e799b1e1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.042937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 51/102] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:19.049495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6fea-5fc8-41d4-8be3-9255120d737e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.050217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6fea-5fc8-41d4-8be3-9255120d737e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.050704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6fea-5fc8-41d4-8be3-9255120d737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.081529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-872d6fea-5fc8-41d4-8be3-9255120d737e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:19.083220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-872d6fea-5fc8-41d4-8be3-9255120d737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:19.167316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6866a-50c8-4709-aa04-86111497180b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.168371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6866a-50c8-4709-aa04-86111497180b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.169136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6866a-50c8-4709-aa04-86111497180b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.179769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 52/103] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:19 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:19.186815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:19.192077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.192983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.193727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.197932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 52/104] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:19.225055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65116-1206-427e-af7f-63beb1c97621 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.225055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65116-1206-427e-af7f-63beb1c97621 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.225055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f65116-1206-427e-af7f-63beb1c97621 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.226637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 53/105] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:19.232903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:19.234162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:19.241261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.241547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.242017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.279634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:19.279873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:19.281158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:19.437310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 53/106] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:19.438848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 54/107] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:19.459966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:19.522385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:19.659731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901f89b-8d90-4103-838d-42b051dc6ebf None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:19.714892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7aeb74-5882-49cd-a0a4-f083662ae6e2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:19.761282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:19.778529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:19.779654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.780167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.780726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.809287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:19.809831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:19.811262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:19.811982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:19.812725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:19.815221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:19.817146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:19.819492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 55/108] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:19.821563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:19.842041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:19.852697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:19.854337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:19.855863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:19.859534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 54/109] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:19.861408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:19.887305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:19.965289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbcd38-4f9d-4207-b376-c9b58f77dfd4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.010402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109477-a081-4879-bc69-3ed4a73c4ebd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.017992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.018978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.019424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.019863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.037580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:20.046221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:20.047139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:20.047927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:20.052684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 56/110] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:20.053961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.070368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.071178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.071597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.071995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.073559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.075469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.084124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 55/111] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:20.084124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.133946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.207335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.214672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead41e98-3d98-4031-8bf1-a4b29460de48 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.243162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f0184-697c-48d3-bd38-73f8751f744e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.265551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.266179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.266462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.266742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.267958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:20.268298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.269701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.279382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 57/112] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:20.280305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.284016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.285174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.285673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.286145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.305385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:20.313054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:20.314790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:20.316195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 56/113] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:20.317548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.411286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd164c-be4a-4cb6-9e6e-39e6b1644078 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.427163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.452885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.453712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.454080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.454952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.455782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:20.456265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.457766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.470625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 58/114] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:20.471849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.478123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef0175-6e14-419b-9295-25df15579fd6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.541743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.542412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.542677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.542993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.543788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:20.544095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.545792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12a189-73b1-4ba5-bcd5-9fae627f6642 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.552984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.556955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 57/115] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:20.563522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18930b-2f5a-4d85-9fb7-4a8e316bda8b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.563522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18930b-2f5a-4d85-9fb7-4a8e316bda8b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.563522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18930b-2f5a-4d85-9fb7-4a8e316bda8b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.565835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 58/116] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:20.566736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18930b-2f5a-4d85-9fb7-4a8e316bda8b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.613905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78ef3b-c317-4735-bd03-45d59e37cc27 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.667244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.668003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.668452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.668870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.669786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.671520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.710987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18930b-2f5a-4d85-9fb7-4a8e316bda8b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.755356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:20.756511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:20.756995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:20.757675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:20.759915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:20.773448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 59/117] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:40:20 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:20.773448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.773774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:20.773774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 59/118] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:20.773774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:20.818988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.909761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:20.949166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a273f4-dec7-439d-80e5-6138e5b05839 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:20.979871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6477cd-afea-4ba2-be95-bc9994c08b74 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.005514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.006480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.006760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.008322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.008322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:21.008322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.009900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.025339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 60/119] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.027277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.043072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.043717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.043997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.044314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] PATH_INFO: `/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.061803 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] RBAC: Authorizing `identity:get_user(user_id=bd4499c25d4e4aba87df3fb2ffd5fd3b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.063499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31948bd-44bf-4615-a009-591b4b22160e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.065535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 60/120] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:20 2022] GET /identity/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.066676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.067034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.067237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.088090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:21.089348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:21.180783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:21.197086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426d2fe-29cc-43f1-a8ad-ab804c55bf6e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.208520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 61/121] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:21.208520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.266534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.268369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.268863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.269358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.271585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.274285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.278150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 61/122] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.279682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.332717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:21.404958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4c1e3-41de-454e-beab-c1de442903f6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.450798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.451873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.452392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.452862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.454387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.456316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.458401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 62/123] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.459707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.533918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa72d02-34d8-47a9-bfb9-8af47102334c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.611671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.612765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.613299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.613808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.614514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86614ef4-3a09-4c52-8bab-9c093fb0676a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.615904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.618673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.622049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 62/124] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.623444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.664850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:21.677186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:21.686635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.687330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.687731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.688275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.809514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72630349-4cc8-4f8f-8d6d-0b7693d21cef None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:21.820162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.824131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.863128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:21.864322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:21.864840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:21.865345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:21.867544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:21.870487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:21.873964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 63/125] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:21.875259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:21.969155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 63/126] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:21.971175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.018898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:22.056776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:22.072340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9bd8f-b413-412c-b5dc-d27c11f24248 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.129615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.130447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.130590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.130859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/afeb2be505e94df19e94891e551428f4/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.133143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, user_id=afeb2be505e94df19e94891e551428f4, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:22.134703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:22.147297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02dfe9-ed48-4452-9fd1-0aee046bf5d5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.187621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.188319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.188609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.189413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.190673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:22.192181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:22.193965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 64/127] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:21 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:22.194770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.220522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 64/128] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:21 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/afeb2be505e94df19e94891e551428f4/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:22.220522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.376451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:22.394057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e7809-32fb-4bd4-9765-7d08cd89e074 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.395720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c5ffc-b055-4a1e-b28b-5aa87319ad36 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.456532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.456742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.457411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.457620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.457738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.457971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/1dee14b5375a4327b3046a21c8c67366/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.458129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.458574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.460050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, user_id=1dee14b5375a4327b3046a21c8c67366, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:22.461596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:22.483336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:22.493351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:22.494321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:22.495182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:22.495820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 65/129] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:22.496838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.580472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 65/130] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:22 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/1dee14b5375a4327b3046a21c8c67366/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:22.581718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.612847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:22.658534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2baa5f-59de-4b13-a336-43e7bf74549d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.708095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.708792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.709089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.709369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.713476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:22.715114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:22.717225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 66/131] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:22 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:22.724243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:22.757637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:22.893406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ebdc4-b5cd-4e16-a878-181845a9e780 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.960648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47dadf-745f-4009-9e71-b0af7fb5cbca None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:22.970909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:22.972641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:22.973475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:22.974266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/afeb2be505e94df19e94891e551428f4/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:22.978690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, user_id=afeb2be505e94df19e94891e551428f4, role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:22.981922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:23.014648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:23.016248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.016836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.017368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:23.018586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:23.019155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:23.022004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:23.040606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 67/132] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:23.042243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:23.100534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 66/133] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:22 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/afeb2be505e94df19e94891e551428f4/roles/21008fb2299d4f8cba069e6c99468411 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:23.105110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:23.281831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:23.323915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfbcb7-3bda-4584-a5b9-4de9cc037f8c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:23.342496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:23.418529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bade0-a74f-4240-98eb-998abf820aaf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:23.454994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:23.456099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.456648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.457158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:23.458598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=bd4499c25d4e4aba87df3fb2ffd5fd3b) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:23.459163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:23.462059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:23.464898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013627-c118-412b-93c8-70541d66792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:23.465804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013627-c118-412b-93c8-70541d66792a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.466265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013627-c118-412b-93c8-70541d66792a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.466745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49013627-c118-412b-93c8-70541d66792a None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:23.468188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013627-c118-412b-93c8-70541d66792a None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:23.470573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49013627-c118-412b-93c8-70541d66792a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:23.472694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 67/134] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:23 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:23.478964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013627-c118-412b-93c8-70541d66792a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:23.487869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 68/135] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:23 2022] GET /identity/v3/role_assignments?user.id=bd4499c25d4e4aba87df3fb2ffd5fd3b&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 259 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:23.705937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49013627-c118-412b-93c8-70541d66792a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:23.763923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:23.764885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.765181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.765471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] PATH_INFO: `/v3/projects/993460ab4c67460aa69001511da372d6` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:23.766970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] RBAC: Authorizing `identity:get_project(project_id=993460ab4c67460aa69001511da372d6)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:23.768594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fd4752-8290-4382-8237-9c476e3078e1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:23.770672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 68/136] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:23 2022] GET /identity/v3/projects/993460ab4c67460aa69001511da372d6 => generated 312 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:23.778016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:23.948581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9b63b-9b03-42d2-bcd9-735f66209610 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:23.961401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82e52-c91d-47dc-b7b7-1c0dac1d950f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.961914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82e52-c91d-47dc-b7b7-1c0dac1d950f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.961987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c82e52-c91d-47dc-b7b7-1c0dac1d950f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:23.963651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 69/137] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:23.969893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:23.970836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:23.971125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:24.007308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:24.008585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:24.012582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:24.036408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:24.037107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:24.037385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:24.037664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] PATH_INFO: `/v3/projects/993460ab4c67460aa69001511da372d6/users/afeb2be505e94df19e94891e551428f4/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:24.039802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] RBAC: Authorizing `identity:create_grant(project_id=993460ab4c67460aa69001511da372d6, user_id=afeb2be505e94df19e94891e551428f4, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:24.041356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:24.124709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 69/138] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:23 2022] PUT /identity/v3/projects/993460ab4c67460aa69001511da372d6/users/afeb2be505e94df19e94891e551428f4/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:24.170010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 70/139] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:24.677559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:24.690304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:24.838827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3619bfc-3ee1-4624-a6f4-cb3b380533db None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:24.894240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:24.894929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:24.895222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:24.895500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:24.896873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:24.898438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b06609-e6de-4f23-a28a-7d4025d51f28 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:24.900900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 70/140] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:24.907371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:25.070923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b33d0-330e-46f8-a8d2-26c5fc5bd2f6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:25.133265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:25.133820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:25.134106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:25.134384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:25.135095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:25.136652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5f33d-a7fe-4d88-931a-ed42621d9705 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:25.151262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:25.261547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 71/141] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:24 2022] POST /identity/v3/users => generated 283 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:40:26.647985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed3345-7f1b-4561-b476-f0a8cb79e0e6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:26.648827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed3345-7f1b-4561-b476-f0a8cb79e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:26.648827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed3345-7f1b-4561-b476-f0a8cb79e0e6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:26.650019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 71/142] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:26.656398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab387-5c78-4e9f-b44d-415831b3d9f7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:26.657168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab387-5c78-4e9f-b44d-415831b3d9f7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:26.657168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ab387-5c78-4e9f-b44d-415831b3d9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:26.689745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9b5ab387-5c78-4e9f-b44d-415831b3d9f7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:26.691029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9b5ab387-5c78-4e9f-b44d-415831b3d9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:26.716707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443827-2d39-40d8-a424-9f0200906924 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:26.716975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443827-2d39-40d8-a424-9f0200906924 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:26.717260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443827-2d39-40d8-a424-9f0200906924 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:26.718678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 72/143] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:26.724821 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a8c7-4330-4769-aa79-93dcfeebd156 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:26.725209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a8c7-4330-4769-aa79-93dcfeebd156 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:26.725437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a8c7-4330-4769-aa79-93dcfeebd156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:26.754484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1102a8c7-4330-4769-aa79-93dcfeebd156 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:26.755848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1102a8c7-4330-4769-aa79-93dcfeebd156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:26.871412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 72/144] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:26.908661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 73/145] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:27.157966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60f3c-d3f7-4a8c-af90-1717e2f93641 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:27.158198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60f3c-d3f7-4a8c-af90-1717e2f93641 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:27.158597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d60f3c-d3f7-4a8c-af90-1717e2f93641 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:27.159843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 73/146] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:27.167000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df79d4-4fc3-4ceb-b709-d507036a9b98 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:27.168001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df79d4-4fc3-4ceb-b709-d507036a9b98 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:27.168812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df79d4-4fc3-4ceb-b709-d507036a9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:27.184456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:27.210036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-72df79d4-4fc3-4ceb-b709-d507036a9b98 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:27.212521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-72df79d4-4fc3-4ceb-b709-d507036a9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:27.367945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 74/147] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:27.417525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f3d0-f5ed-4813-b56c-41e0e6a21858 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:27.417766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f3d0-f5ed-4813-b56c-41e0e6a21858 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:27.418107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73f3d0-f5ed-4813-b56c-41e0e6a21858 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:27.419384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 74/148] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:27.427098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:27.427993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:27.428775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:27.468176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:27.470823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:27.481097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f3d0-f5ed-4813-b56c-41e0e6a21858 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:27.622429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 75/149] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:27.623694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:27.732691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:27.817420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca85d01-d088-466d-a4f6-083d5d0a8597 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:27.882557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73f3d0-f5ed-4813-b56c-41e0e6a21858 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:27.898553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:27.899367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:27.899653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:27.899927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:27.925684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:27.931132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:27.932101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:27.932910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 76/150] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:27.940336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:27.971040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:28.021556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:28.022664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:28.023168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:28.023666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:28.069902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:28.089017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:28.089958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:28.090852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:28.091430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 75/151] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 611 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:28.101017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:28.159439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c61ab-1350-49d6-9a9e-e463826cdfac None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:28.224634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:28.238719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:28.239364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:28.239648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:28.239927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:28.240663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:28.240976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:28.246479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:28.265570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 77/152] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:28.266465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:28.554056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392e9b2-1083-4f34-a062-d2a804b27183 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:28.557433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a30583-5b61-44ec-8184-9c371d7ed21c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:28.629132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:28.629813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:28.630093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:28.630375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:28.650547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:28.666057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:28.667087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:28.667851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 78/153] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:28.668570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:28.719353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:28.720482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:28.720954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:28.721391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:28.722667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:28.723289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:28.734156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:28.763763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 76/154] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 664 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:28.765236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:28.808708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:28.933600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5fc9b-cbbc-45ea-97c4-1ff6974897c9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:28.948779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:29.011832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.012539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.012890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.013176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] PATH_INFO: `/v3/users/1dee14b5375a4327b3046a21c8c67366` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.017190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] RBAC: Authorizing `identity:get_user(user_id=1dee14b5375a4327b3046a21c8c67366)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:29.019394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:29.021712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 79/155] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:28 2022] GET /identity/v3/users/1dee14b5375a4327b3046a21c8c67366 => generated 247 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:29.022379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:29.171950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8a07b-8d24-4603-8cb9-36879b183bff None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.243839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.244537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.244823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.245102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.267922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:29.275417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfb480-9ae1-47ea-815c-62304c282310 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:29.278597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:29.279502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:29.280379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 77/156] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 516 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:29.281200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:29.324636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:29.425485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.426422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.426889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.427339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.428594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:29.429139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:29.440484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:29.460358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 80/157] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:29.461593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:29.484418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b38828-6a6f-4548-be04-9e841c6f8115 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.493918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:29.527526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.528488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.529184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.529681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.536243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:29.536243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:29.536243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 78/158] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:29 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:29.537100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:29.663825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3660d-fa56-4b2a-98f2-e98052c085cc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.696415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc86e24-1ada-4a30-b2c2-e9a191333bda None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.705254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.705895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.706192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.706476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.707174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:29.707490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:29.709039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:29.719835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 79/159] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:29.721392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:29.784015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:29.797717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:29.799386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:29.799672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:29.799946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:29.888659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:29.923252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b8786-6b15-41c9-964d-3018fce36954 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:29.936317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:29.938252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad30c0-62ca-4ded-b3d3-83ff084fbb59 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:30.015135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:30.016411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.017384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.017856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.019722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:30.023498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:30.025823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 80/160] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:29 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:30.029333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:30.126921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 81/161] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:30.126921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273ef4-12b9-445e-97e0-43ab09ac3575 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.126921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273ef4-12b9-445e-97e0-43ab09ac3575 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.126921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26273ef4-12b9-445e-97e0-43ab09ac3575 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.127345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 82/162] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:30.128232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26273ef4-12b9-445e-97e0-43ab09ac3575 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:30.229865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:30.231830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47278c-a8cc-4ede-a362-e35d990b74f0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:30.240692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:30.265519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26273ef4-12b9-445e-97e0-43ab09ac3575 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:30.309128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:30.309841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.310127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.310408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] PATH_INFO: `/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.311654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4499c25d4e4aba87df3fb2ffd5fd3b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:30.313211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:30.315825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 83/163] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:30 2022] GET /identity/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:30.316847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:30.327310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:30.327960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.328270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.328552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.412737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:30.414258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11a73b-4fb4-47aa-9b13-744fe011c607 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:30.535687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 81/164] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:30.541050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.541387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.541615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.561939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:30.570916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:30.572404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:30.603876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d5573-fb33-4147-a431-6f339f8c2a04 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:30.667352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:30.668407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:30.668881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:30.669411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:30.693744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:30.709945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 82/165] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:30.716518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:30.769944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:30.771660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:30.912191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 84/166] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:30.913011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:30.986654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:30.989238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad65b-8295-45aa-9765-316900caf8c0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.048336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.050555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.051060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.051573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.054715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.058084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.062404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 83/167] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:30 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:31.065213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.071979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:31.076417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf00af-5f10-42fa-9beb-1fa0e1cef5e8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.125441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.126092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.126427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.126802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.128076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.129646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1862623-156c-4b2b-97a7-bdf8739c9602 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.131688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 85/168] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:30 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:31.132701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883717-6d2a-467b-9caa-3ce13bef48ee None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.132982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883717-6d2a-467b-9caa-3ce13bef48ee None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.133319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f883717-6d2a-467b-9caa-3ce13bef48ee None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.140371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 86/169] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:31.140371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f071-5142-4e45-bd3a-ac64f887e40b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.140371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f071-5142-4e45-bd3a-ac64f887e40b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.140371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062f071-5142-4e45-bd3a-ac64f887e40b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.142479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 87/170] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:31.143020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062f071-5142-4e45-bd3a-ac64f887e40b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.226380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0554d8-e5e7-4923-85e0-307f5aa0a456 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.265447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062f071-5142-4e45-bd3a-ac64f887e40b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.267467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.268120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.268436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.268714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.269923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.271398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.273269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 84/171] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:31.274086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.281633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:31.307397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.308245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.308665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.309123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.311035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.313098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.316131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 88/172] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:31.317344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.361855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:31.402331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17160d8-ad37-4e5a-a763-16931bb480aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.442337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.442991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.443268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.443573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.444347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=1dee14b5375a4327b3046a21c8c67366) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:31.444658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.446135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.452799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 85/173] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/role_assignments?user.id=1dee14b5375a4327b3046a21c8c67366&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:31.455525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.472962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc021d3a-3f37-4e2b-9e79-1cd4db197fec None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.546176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.547308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.547817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.548851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.574796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-9268283c-0b38-4fa8-bea4-2eac2c5fda2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:31.580056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:31.581947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 89/174] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:31.583338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cacd-57f4-485b-8d27-275e075d6ee8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.585084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cacd-57f4-485b-8d27-275e075d6ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.585084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cacd-57f4-485b-8d27-275e075d6ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.604750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ce67cacd-57f4-485b-8d27-275e075d6ee8 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:31.606040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ce67cacd-57f4-485b-8d27-275e075d6ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:31.656547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:31.674275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42dbfd-cd45-407b-81e4-d16ec09c0bb5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:31.719618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 90/175] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:31.721000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505aa0-43d7-40a4-8da6-a16e5682edf8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.721315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505aa0-43d7-40a4-8da6-a16e5682edf8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.721560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b505aa0-43d7-40a4-8da6-a16e5682edf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.728622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:31.731705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.733735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.733735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/bd4499c25d4e4aba87df3fb2ffd5fd3b/roles/bc67532bb5de43a08d508df3b68e57a4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.737677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, user_id=bd4499c25d4e4aba87df3fb2ffd5fd3b, role_id=bc67532bb5de43a08d508df3b68e57a4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:31.739973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:31.744133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:31.748630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2b505aa0-43d7-40a4-8da6-a16e5682edf8 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:31.750258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2b505aa0-43d7-40a4-8da6-a16e5682edf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:31.874800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 91/176] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:31.877571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aadc8-1649-43fc-a0c5-d75b0fd56b1a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:31.878041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aadc8-1649-43fc-a0c5-d75b0fd56b1a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:31.878510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aadc8-1649-43fc-a0c5-d75b0fd56b1a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:31.881059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 92/177] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:31.882558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aadc8-1649-43fc-a0c5-d75b0fd56b1a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:31.897988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 86/178] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:31 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/users/bd4499c25d4e4aba87df3fb2ffd5fd3b/roles/bc67532bb5de43a08d508df3b68e57a4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:31.900946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:32.290373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f5080-3d6a-430d-af51-d22c01406c98 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.341982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:32.342608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.342893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.343170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.343908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:32.344282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:32.345950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:32.354402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 87/179] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=21008fb2299d4f8cba069e6c99468411 => generated 608 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:32.355461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:32.365793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:32.371047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aadc8-1649-43fc-a0c5-d75b0fd56b1a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.442512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:32.442512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.442512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.442512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.446790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:32.446790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:32.446790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2b4b7-42f5-42ab-a0b1-00722776c093 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:32.464241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 93/180] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:31 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=fd19870371784c8facf151d36c77a6b5 => generated 608 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:32.464241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.464241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.464241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.467017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:32.482982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:32.484271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:32.560942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924b51b-7ca6-45ff-b81c-643ee663003b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.590942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 94/181] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:32.591959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:32.657239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:32.657239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.657239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.657239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.658188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:32.658188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:32.659479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:32.680359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 88/182] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:32.681267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:32.728329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:32.737959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff273af-0eb6-4b19-9455-bab3c461c83e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.788139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:32.788835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.789118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.789394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.805592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:32.813188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:32.814400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 95/183] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:32.815170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:32.891732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49678f-9750-4bb5-b1ce-16c96be9a422 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.923240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:32.948474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:32.949142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:32.949424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:32.949707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:32.968938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:32.975053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2763c-ca90-4b51-84af-80f5131d6384 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:32.975745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:32.976660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:32.977524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 89/184] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:32.978213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.031510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.032294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.032683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.033449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] PATH_INFO: `/v3/users/afeb2be505e94df19e94891e551428f4` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.034750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] RBAC: Authorizing `identity:get_user(user_id=afeb2be505e94df19e94891e551428f4)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.036352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.038166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 96/185] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:32 2022] GET /identity/v3/users/afeb2be505e94df19e94891e551428f4 => generated 275 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.039066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.074273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:33.130053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae849f-1c29-4ed7-bc79-b92ae089364e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.175480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.176098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.176411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.176687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.177387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:33.177696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.179200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.184359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe9813-0aee-4695-aa2a-be9f008a8167 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.189140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 90/186] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.194554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.232521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.233505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.233801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.234104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.235138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:33.236073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.238073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.256953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 97/187] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.256953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.257470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:33.347463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fbcae-ca87-4399-936e-c0f8f43fff19 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.391025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:33.392894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.393587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.393920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.394216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.395884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.398849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.402227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 91/188] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.403725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.415132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10437a-5aec-4db1-ad64-ec9dd979efe9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.460826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.461449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.461734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.462007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.554328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.555951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.634568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f6ac3-849d-4bc0-8597-0bcb710e15bc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.665502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:33.701863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:33.710275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.711111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.711462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.711810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.725148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 98/189] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:33.726304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.736876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.738835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.740884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 92/190] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.744437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.856844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf96d-d20c-4488-a9ca-61dff10780a0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.897461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ad52b-348f-4464-954b-57d29235fa3d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:33.905608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.906262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.906544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.906817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.908741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.910161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.916528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 99/191] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:33.916528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:33.986199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:33.987077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:33.987514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:33.987932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:33.988867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:33.990564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:33.999995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.053001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd339452-e726-4053-b010-6f06112dea6c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:34.090374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:34.091028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:34.091308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:34.091581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] PATH_INFO: `/v3/projects/993460ab4c67460aa69001511da372d6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:34.092811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] RBAC: Authorizing `identity:get_project(project_id=993460ab4c67460aa69001511da372d6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:34.094426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:34.101566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 100/192] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:33 2022] GET /identity/v3/projects/993460ab4c67460aa69001511da372d6 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:34.101566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:34.108182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 93/193] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:33 2022] POST /identity/v3/users => generated 297 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:34.109015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:34.156231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.254813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e86ee-7027-4ecc-8abb-84335fc4473d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:34.256517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1b525-866f-40e3-ac89-47547a02f9ab None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:34.289981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.307516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:34.308141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:34.308471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:34.308747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:34.312754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:34.315343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:34.315896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:34.316401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:34.415095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:34.415773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:34.419230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:34.419230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:34.455699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.596460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 101/194] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:34.597834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:34.616470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 94/195] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:34.617688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:34.661313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.780008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054621d9-ac18-4d0e-95d7-3b84b2af2157 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:34.796920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1675d-23e6-4cbd-9e23-f7d3b4448000 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:34.836766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:34.837403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:34.837687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:34.837960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:34.838974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=993460ab4c67460aa69001511da372d6, user.id=afeb2be505e94df19e94891e551428f4) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:34.839284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:34.844619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:34.867289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 102/196] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/role_assignments?user.id=afeb2be505e94df19e94891e551428f4&scope.project.id=993460ab4c67460aa69001511da372d6&role.id=fd19870371784c8facf151d36c77a6b5 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:34.869333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:34.869596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:34.925424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:34.926231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:34.926602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:34.926948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:34.929069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:34.931512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:34.935602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 95/197] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:34.945296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:35.084777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:35.146343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58443f-d36e-4ba6-9e77-54d9a0cc6fea None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:35.258478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:35.259254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:35.259472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:35.259708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:35.261026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:35.262578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:35.267222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 103/198] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:35.270590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e09dc-92cf-4578-9dbd-6081673ec22a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:35.273313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:35.369711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:35.371235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:35.372013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:35.372786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:35.374609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=d9c25317a2504ece81c5fa1edaed7efe) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:35.375605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:35.381674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798811-831c-4285-b7a3-9ca666257219 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:35.394019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 96/199] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:34 2022] GET /identity/v3/role_assignments?user.id=d9c25317a2504ece81c5fa1edaed7efe&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=21008fb2299d4f8cba069e6c99468411 => generated 259 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:35.407206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd25a8e-3440-4f53-ae5e-962108c1ff9b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:35.474654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:35.475577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:35.475577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:35.476008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:35.476634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=d9c25317a2504ece81c5fa1edaed7efe) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:35.476953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:35.478484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d22f0da-ca40-4391-add6-517a9981a4fc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:35.489202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 104/200] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:35 2022] GET /identity/v3/role_assignments?user.id=d9c25317a2504ece81c5fa1edaed7efe&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:35.536765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf00fe-b827-4d91-a9fe-74d8b9e099b9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:35.538311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf00fe-b827-4d91-a9fe-74d8b9e099b9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:35.539170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf00fe-b827-4d91-a9fe-74d8b9e099b9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:35.542393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 97/201] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:35.549571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:35.550003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:35.550135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:35.580816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:35.582122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:35.606345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:35.698957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 105/202] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:36.124012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf00fe-b827-4d91-a9fe-74d8b9e099b9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:36.250792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:36.348451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf00fe-b827-4d91-a9fe-74d8b9e099b9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:36.418487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:36.420181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:36.420996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:36.421755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:36.445202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:36.457308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:36.459086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:36.460857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:36.465648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 98/203] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:36.473849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:36.699512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aabb11-2c5a-4d10-997e-4c33df9bbb72 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:36.790076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:36.791088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:36.791570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:36.792054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:36.793312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:36.793848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:36.796498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:36.824426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 106/204] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:36.834197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:37.088060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3c120-798e-4887-8b76-bc6acaa45df5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:37.119371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:37.160675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:37.161771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.162264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.162752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] PATH_INFO: `/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.165074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4499c25d4e4aba87df3fb2ffd5fd3b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:37.167879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48487a-dbd0-4389-8247-891dc5ec2ad6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:37.171512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 99/205] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:36 2022] GET /identity/v3/users/bd4499c25d4e4aba87df3fb2ffd5fd3b => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:37.180802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:37.216358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:37.429169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62ad64-cf65-45e7-9711-f0f617af40dd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:37.521898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:37.523453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.524284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.525053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.667744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:37.667744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb705d70-b28f-4272-ad04-9dd5ba2948db None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:37.712940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:37.721941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbfa4-7f51-4e22-8b6e-b62c3f69a415 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.722796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbfa4-7f51-4e22-8b6e-b62c3f69a415 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.723482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fbfa4-7f51-4e22-8b6e-b62c3f69a415 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.726378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 100/206] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:37.740333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f25fe6-c408-4d9f-b76f-e5ebdbacaf70 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.743814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f25fe6-c408-4d9f-b76f-e5ebdbacaf70 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.744648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f25fe6-c408-4d9f-b76f-e5ebdbacaf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.787698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f4f25fe6-c408-4d9f-b76f-e5ebdbacaf70 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:37.790183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f4f25fe6-c408-4d9f-b76f-e5ebdbacaf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:37.857395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 107/207] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:37.859241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15692767-41de-4484-8d2b-fdfb5b43107a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.859763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15692767-41de-4484-8d2b-fdfb5b43107a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.860221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15692767-41de-4484-8d2b-fdfb5b43107a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.862948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 108/208] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:37.866542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15692767-41de-4484-8d2b-fdfb5b43107a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:37.935561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 101/209] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:37.937706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:37.938445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:37.938900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:37.974339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:37.975919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:38.038079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15692767-41de-4484-8d2b-fdfb5b43107a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:38.057784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:38.062463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 102/210] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:38.153591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:38.154753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:38.155258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:38.155753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:38.158768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:38.161629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:38.165405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 109/211] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:37 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:38.173701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:38.266792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:38.393272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc7712-ee75-4da6-ae2e-a9a3ec8e1055 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:38.393837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:38.530783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99246862-e4ba-4cdc-89c9-02c03a5cfe4c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:38.549418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:38.550373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:38.550878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:38.551364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:38.552794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, scope.project.id=a27997214a454ab9a0febb5bf21c27b5, user.id=bd4499c25d4e4aba87df3fb2ffd5fd3b) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:38.553655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:38.556054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ec165-7eb1-4e2a-8f5a-99e0d239573d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:38.576943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:38.578063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:38.578558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:38.579120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:38.587781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 103/212] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:38 2022] GET /identity/v3/role_assignments?user.id=bd4499c25d4e4aba87df3fb2ffd5fd3b&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 608 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:38.594267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:38.594587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932208c-bdc0-432d-a94c-88bfb79b919b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:38.595135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932208c-bdc0-432d-a94c-88bfb79b919b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:38.595585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932208c-bdc0-432d-a94c-88bfb79b919b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:38.598122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 104/213] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:38.601420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:38.602394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:38.603193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:38.606036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 110/214] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:38.611227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:38.611227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:38.611227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:38.618307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:38.653409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:38.657466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:38.697940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:38.768610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 105/215] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:38.773923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:38.896442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:38.904064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96af72d-920a-4839-900e-9dcfa238c2ad None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:38.975711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e58586-0fe2-43ed-83f3-517a93ec3e4b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.016352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.017299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.017713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.018127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.018615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.019175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:39.019307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.019595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.019919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.020064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.021182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.021967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.022656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.024579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 106/216] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:39.030525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.035356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 111/217] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:39.042251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.178561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a683eb8-79a9-42ff-b2ae-c9d4adc8d55e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.188741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:39.201924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:39.206999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200555d3-d7fd-4ee4-ad5d-83853dac093b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.247275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.247575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.247709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.248012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.248935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.250519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.257520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.258190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.258492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.258735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] PATH_INFO: `/v3/users/7ee78fdeb41a4396aface7093389f39b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.280966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee78fdeb41a4396aface7093389f39b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.282479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.284884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 112/218] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/users/7ee78fdeb41a4396aface7093389f39b => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:39.285706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.384423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 107/219] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:39 2022] POST /identity/v3/users => generated 297 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:40:39.396456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.402063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeecb0-75b2-4d59-a65f-49b13b9dcbb6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.454992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.455575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.455866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.456148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.469155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-677a2f48-3ca4-4ba8-8cea-671c9763b5f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:39.474843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:39.476863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 113/220] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:39.478709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3a12-fbd4-448a-9987-b6f033e57662 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.480672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3a12-fbd4-448a-9987-b6f033e57662 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.480672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f3a12-fbd4-448a-9987-b6f033e57662 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.480672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 114/221] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:39.485135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3a12-fbd4-448a-9987-b6f033e57662 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.517597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:39.564171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f10b-61f1-4c34-ace8-7daac5cc6e4a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.614242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.614242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.614242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.614242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.652181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f3a12-fbd4-448a-9987-b6f033e57662 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:39.659157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:39.713271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.713524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:39.713524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.713524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.713524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.714176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.714303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:39.714303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:39.714499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d2c24-0dbb-40d9-9834-46b848186e31 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:39.727378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 115/222] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:39.728987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:39.729474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:39.729754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:39.760886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:39.762132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:39.860369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 116/223] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:39.870815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.870959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 108/224] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:39.872055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:39.961548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:39.984761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:40.019155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0767cd6-a128-4fb6-ae90-f85b20c08fc1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:40.067326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:40.068934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:40.069463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:40.069938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:40.071500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:40.073474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:40.075793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 109/225] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:40.082535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:40.160174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48db5-e6ab-4ce7-bbbb-6146ffadc19d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:40.223803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78718f2b-4a38-4ec1-b3a9-8e25cc542702 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:40.243956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:40.245146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:40.245715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:40.246561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:40.248681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:40.251706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:40.255544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 117/226] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:39 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:40.256877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:40.268223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:40.276417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:40.278128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:40.278620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:40.279075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:40.280099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=7ee78fdeb41a4396aface7093389f39b) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:40.281107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:40.283887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:40.291518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 110/227] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:40 2022] GET /identity/v3/role_assignments?user.id=7ee78fdeb41a4396aface7093389f39b&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=fd19870371784c8facf151d36c77a6b5 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:40.297648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:40.507976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:40.604364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114cbdd-6aa0-4846-8437-cb5be9f8382c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:40.640258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb6b5e-f443-4639-9fdb-d40e43c07e9f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:40.688081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:40.689763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:40.690484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:40.691369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:40.712236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:40.714474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:40.715507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:40.715986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:40.716521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:40.718545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:40.721925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:40.724716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:40.726355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:40.727894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:40.729132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 111/228] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:40 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:40.732468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 118/229] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:40.737593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:40.740251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:40.884823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:40.962194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f5076-88aa-43ac-9e22-282f624e06bd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:41.038027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:41.039957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:41.040488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:41.040980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/users/d9c25317a2504ece81c5fa1edaed7efe/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:41.044703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, user_id=d9c25317a2504ece81c5fa1edaed7efe, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:41.048245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:41.085144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951784e-c45a-44b3-b158-d3f0f15c651b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:41.127716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:41.128396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:41.128674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:41.128931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:41.129650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:41.129953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:41.131375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:41.134395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:41.144464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 119/230] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:41.149901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:41.154655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 112/231] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:40 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/users/d9c25317a2504ece81c5fa1edaed7efe/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:40:41.280844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4b30c-3fe2-4575-bea1-c5e6cf58e6d2 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:41.328344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:41.329442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:41.329972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:41.330437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:41.332723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:41.335822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:41.344437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 120/232] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:41 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:41.352368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:41.606144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335ae4-91e1-484a-93a7-1b973c595bec None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:41.652498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:41.685501 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:41.686581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:41.687073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:41.687569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:41.691532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:41.694365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcf9e1-4b7b-4dcb-bf0f-8a3fa63cb9c4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:41.697651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 113/233] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:41 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:41.704420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:41.853290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:41.878353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874322d9-d382-4114-b760-d25fb8708fd9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:41.942219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:41.943380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:41.943885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:41.944421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/users/d9c25317a2504ece81c5fa1edaed7efe/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:41.951602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, user_id=d9c25317a2504ece81c5fa1edaed7efe, role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:41.954511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35aec47-79e3-494a-99d2-8c9ff329be0c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:42.091707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 121/234] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:41 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/users/d9c25317a2504ece81c5fa1edaed7efe/roles/21008fb2299d4f8cba069e6c99468411 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:43.042110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb92e-2128-4927-b27e-5e75018a4b19 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.043904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb92e-2128-4927-b27e-5e75018a4b19 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.044718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdb92e-2128-4927-b27e-5e75018a4b19 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.047865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 114/235] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:43.055150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9b92-86fd-4279-bb86-a6959e948257 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.056142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9b92-86fd-4279-bb86-a6959e948257 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.056969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9b92-86fd-4279-bb86-a6959e948257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.097236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f20a9b92-86fd-4279-bb86-a6959e948257 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:43.102933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f20a9b92-86fd-4279-bb86-a6959e948257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:43.154615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29685b-42f9-4d2a-a2ac-1350f1302cb7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.155609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29685b-42f9-4d2a-a2ac-1350f1302cb7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.156425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29685b-42f9-4d2a-a2ac-1350f1302cb7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.159523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 115/236] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:43.166426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dff1-0fb7-4888-8237-12502a53f29b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.167334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dff1-0fb7-4888-8237-12502a53f29b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.168260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2dff1-0fb7-4888-8237-12502a53f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.242060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5ba2dff1-0fb7-4888-8237-12502a53f29b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:43.252512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5ba2dff1-0fb7-4888-8237-12502a53f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:43.368735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 122/237] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:43.410228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 116/238] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:43.522632 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df993e-d45b-4618-a795-f7bf8207ce93 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.523098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df993e-d45b-4618-a795-f7bf8207ce93 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.523548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df993e-d45b-4618-a795-f7bf8207ce93 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.526788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 123/239] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:43.533252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.533712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.534213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:43.581213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:43.583226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:43.741248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df993e-d45b-4618-a795-f7bf8207ce93 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:43.762316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 117/240] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:43.764768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:43.855056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:43.882449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:43.939352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df993e-d45b-4618-a795-f7bf8207ce93 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:43.984248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:43.984941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:43.985225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:43.985560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.009906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:44.016194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:44.018039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:44.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:44.023769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 124/241] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:44.036555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:44.097664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2a366-d508-4513-a238-b4598e7b35d9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:44.199482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:44.201297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:44.202049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:44.202796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.206031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:44.209195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:44.212799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 118/242] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:44.214589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:44.281531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca930-f2b6-481e-a0a1-2bf72a7c448e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:44.305415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:44.334997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:44.336147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:44.336996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:44.337555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.338514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:44.339553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:44.341856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:44.364181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 125/243] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:44.365750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:44.421919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb690c-5d6e-481f-abb1-d5b89c8c16c3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:44.459258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:44.499433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:44.499433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:44.500027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:44.500403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.523314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:44.533553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:44.535212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:44.536742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 119/244] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:44.538074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:44.602617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea5e7-0f88-4758-a8df-33c4829282e0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:44.674730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:44.676507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:44.677491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:44.678278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.679776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:44.683090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:44.737280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d877e-79d9-4de5-a246-8dd6638bad1c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:44.799075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 126/245] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:44 2022] POST /identity/v3/users => generated 293 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:44.799075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:44.837554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:44.838645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:44.839391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:44.839875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] PATH_INFO: `/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:44.876278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:44.894946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] RBAC: Authorizing `identity:get_user(user_id=ecb79f5b5a014a49b78cb2b958b9a01b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:44.899514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:44.910676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 120/246] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:44 2022] GET /identity/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b => generated 297 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:44.928743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:45.060624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827a5c-2f5e-4489-bade-08d3f03b9404 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:45.062094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:45.119494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:45.120145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.120468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.120730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.121455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:45.121763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:45.123294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:45.133782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 127/247] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:45.140093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:45.215990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2626-7cfd-4c3a-8709-d437b1305722 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:45.270136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:45.279594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfa7f4d-14d1-4324-8823-6365e47bec52 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:45.291129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:45.292736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.293562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.294343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.337294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:45.338093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.338093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.338363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] PATH_INFO: `/v3/users/7ee78fdeb41a4396aface7093389f39b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.342064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee78fdeb41a4396aface7093389f39b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:45.343609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:45.345439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 128/248] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:45 2022] GET /identity/v3/users/7ee78fdeb41a4396aface7093389f39b => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:45.354047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:45.442728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:45.444289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bf5b-2445-4f1c-bd06-f97d4a9c24f4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:45.513386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:45.579421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5774c-72a2-4e55-aa09-dae21a7d6f75 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:45.605500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 121/249] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:45.606771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7eee0-fa2d-4325-8b7d-88082fe50ba6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.607306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7eee0-fa2d-4325-8b7d-88082fe50ba6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.607306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7eee0-fa2d-4325-8b7d-88082fe50ba6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.609100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 122/250] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:45.616486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7eee0-fa2d-4325-8b7d-88082fe50ba6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:45.657945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:45.659398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.659398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.659878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.664756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:45.666561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86450c92-b353-4fac-a99d-04b27feefe74 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:45.670005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 129/251] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:45 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:45.671927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:45.672403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:45.672859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:45.704034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:45.706321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:45.775009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:45.928920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7eee0-fa2d-4325-8b7d-88082fe50ba6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:45.942516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 130/252] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:45.944009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:46.009473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:46.010444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.010884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.011345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.018334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:46.021056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:46.023444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 123/253] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:45 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:46.032384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:46.040496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:46.227585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7152-a84d-4927-b550-386bc88bf910 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:46.228307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665a53f-cd78-41a1-87b4-afdaf14d647d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:46.297046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:46.297781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.298133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.298434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/users/7ee78fdeb41a4396aface7093389f39b/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.301508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, user_id=7ee78fdeb41a4396aface7093389f39b, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:46.303003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4b86-6edf-4d3b-9f0b-741d134e04da None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:46.307485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:46.308113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.308416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.308759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.309506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=ecb79f5b5a014a49b78cb2b958b9a01b) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:46.309810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:46.311326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:46.329746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 124/254] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:46 2022] GET /identity/v3/role_assignments?user.id=ecb79f5b5a014a49b78cb2b958b9a01b&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:46.394350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 131/255] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:45 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/users/7ee78fdeb41a4396aface7093389f39b/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:40:46.582267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:46.727549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:46.751574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54fba-bc86-4959-b3e7-a3c67883b16b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.752498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54fba-bc86-4959-b3e7-a3c67883b16b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.752761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54fba-bc86-4959-b3e7-a3c67883b16b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.754595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 132/256] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:46.761615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.761894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.762363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.803762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:46.805412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:46.827948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7689a828-be68-4c7d-8e44-e5cb2eb43474 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:46.848028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:46.910068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 133/257] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:46.962604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:46.963736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:46.964527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:46.965026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:46.998133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:47.012946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:47.013911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:40:47.014708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:47.015302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 125/258] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:47.024621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:47.183280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d71fb-ab45-4397-b668-aab5371d0a0d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:47.224997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:47.225891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:47.226326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:47.226745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:47.227618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:47.228067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:47.229663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:47.239757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 134/259] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:47.249143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:47.444844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e7b97-ddd6-4c87-bcd4-f6a206d50396 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:47.459806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:47.493166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:47.497778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:47.514948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:47.515606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:47.515894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:47.516263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:47.521638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:47.524444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:47.528088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 126/260] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:47 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:47.542259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:47.712373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62ed1f-d407-47a9-9e75-79a6301c1a15 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:47.772616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:47.773789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:47.774976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:47.775477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:47.791111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:47.798778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:47.799868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:40:47.800697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:47.804815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 135/261] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:40:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:47.811335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:47.891620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bbf2e-e64c-4cb1-9875-f78eb5de6689 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:47.982302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:47.984177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:47.986688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:47.987851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:48.053223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.136950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.152569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:48.155990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:48.156266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83735fa-8480-4946-bd92-4c11aa207e45 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:48.301451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:48.302494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:48.302983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:48.303477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:48.304772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:48.305323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:48.308054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:48.339590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 136/262] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:40:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 525 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:48.362491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:48.372158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 127/263] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:48.382357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:48.640165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.650984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06dd82-cd54-4af9-9012-dbe705a112b9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:48.661503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a854f-1ab1-43c5-bd23-751271d08c48 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:48.730666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:48.731768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:48.732291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:48.732785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] PATH_INFO: `/v3/users/d9c25317a2504ece81c5fa1edaed7efe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:48.746196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] RBAC: Authorizing `identity:get_user(user_id=d9c25317a2504ece81c5fa1edaed7efe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:48.749444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:48.753322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 137/264] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:48 2022] GET /identity/v3/users/d9c25317a2504ece81c5fa1edaed7efe => generated 283 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:48.760447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:48.763648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:48.763648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:48.763648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:48.769599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:48.771302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:48.774095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:48.782456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.801590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 128/265] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:48 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:48.811482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:49.067426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fcf1c-6a04-461d-a9f1-317aabfbf514 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:49.092718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947911a-1f6f-48a7-9dea-60ac180b060f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:49.147016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:49.148089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:49.148617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:49.149116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:49.150871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:49.151512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:49.151790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:49.152068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:49.152883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=d9c25317a2504ece81c5fa1edaed7efe) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:49.153195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:49.154816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:49.164843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 129/266] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:48 2022] GET /identity/v3/role_assignments?user.id=d9c25317a2504ece81c5fa1edaed7efe&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:49.305227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:49.307999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:49.312964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:49.532440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 138/267] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 764 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:49.542400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:49.602556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:49.749858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30652f4b-0a93-4878-bc95-07706622274d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:49.821228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:49.822268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:49.822767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:49.823175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:49.825484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:49.828164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf1130-0b89-485e-8ccc-a2fcdc848cab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:49.831860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 130/268] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:49 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:49.842767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:49.985804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a34-3d23-44ac-80b0-acf401b7f50f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:49.987357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a34-3d23-44ac-80b0-acf401b7f50f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:49.988169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b1a34-3d23-44ac-80b0-acf401b7f50f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:49.991158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 131/269] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:50.012343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff8a3-9186-4683-847e-05a5903b7060 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.013412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff8a3-9186-4683-847e-05a5903b7060 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.014321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ff8a3-9186-4683-847e-05a5903b7060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.036949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce74270-5b72-4262-a362-aad54ea707b3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:50.043583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:50.059578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-216ff8a3-9186-4683-847e-05a5903b7060 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:50.062436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-216ff8a3-9186-4683-847e-05a5903b7060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:50.102376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:50.102943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.103218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.103495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.104318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=d9c25317a2504ece81c5fa1edaed7efe) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:50.104633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:50.106329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c29183-f051-411a-b132-0a63a8370821 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:50.119067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 139/270] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:49 2022] GET /identity/v3/role_assignments?user.id=d9c25317a2504ece81c5fa1edaed7efe&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=21008fb2299d4f8cba069e6c99468411 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:50.234349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 132/271] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:50.357089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c7ff-f97c-414b-912c-405b15b07679 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.357327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c7ff-f97c-414b-912c-405b15b07679 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.357678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1c7ff-f97c-414b-912c-405b15b07679 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.359150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 140/272] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:50.369104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.370204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.371006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.416471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:50.419260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:50.469936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:50.495909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fb51-eae3-406b-a837-96d10669d231 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.496428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fb51-eae3-406b-a837-96d10669d231 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.496960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693fb51-eae3-406b-a837-96d10669d231 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.499405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 141/273] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:50.512774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a67f8-1eb5-46d9-9497-0a6e1ee719cc None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.513872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a67f8-1eb5-46d9-9497-0a6e1ee719cc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.514493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a67f8-1eb5-46d9-9497-0a6e1ee719cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.548286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 133/274] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:50.551551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-166a67f8-1eb5-46d9-9497-0a6e1ee719cc None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:50.552950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-166a67f8-1eb5-46d9-9497-0a6e1ee719cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:50.643662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 142/275] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:50.828455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:50.862642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e0dc-4a7e-4614-863b-8ae3858a1774 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.864116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e0dc-4a7e-4614-863b-8ae3858a1774 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.864684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e0dc-4a7e-4614-863b-8ae3858a1774 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.866875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 143/276] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:50.873917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:50.874548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:50.875041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:50.899054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:50.900753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:51.002152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 144/277] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:51.110628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fd95-c5fc-4296-9f67-dde390da06b2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.128251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.163514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:51.177824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.178945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.179441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.179944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.199999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:51.210742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:51.212397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:51.213529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 134/278] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:51.214817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.250892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:51.344099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeadf38-7acc-4f7e-873f-07374403c8f5 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.384012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.384697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.384977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.385258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.388949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a9196-830c-4feb-b916-bdac1f2187b5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.397874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:51.402933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:51.404714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 145/279] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:51.406305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.436549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.437122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.437418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.437694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.438920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:51.441011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:51.442721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 135/280] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:51.445509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.522479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:51.537586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672d640-228e-443a-a63d-a3a710cb2a3b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.558629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:51.582007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561e6db-cf97-486b-9dad-3f232ee30ccd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.585730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.586481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.586870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.587238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.588020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:51.588455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:51.590321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:51.600236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 146/281] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:51.601296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.635362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.636493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.636953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.637404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.652959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:51.658220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:51.660004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 136/282] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:51.661667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.750888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91866cd5-4d4f-443f-a06b-78c89c074bde None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.803040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.803633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978dfe0-e177-4b41-b891-98c5f7381d31 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.803751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.804114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.804478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.805297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:51.805719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:51.807771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:51.818529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 147/283] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:51.819503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:51.840269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:51.848513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.849620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.855185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.855185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.855185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:51.855185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:51.940358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d221e6-f814-4446-aa6b-1ca8a79d3e2a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:51.990029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:51.991103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:51.991590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:51.992071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] PATH_INFO: `/v3/users/7ee78fdeb41a4396aface7093389f39b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:51.994156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] RBAC: Authorizing `identity:get_user(user_id=7ee78fdeb41a4396aface7093389f39b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:51.996965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.000311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 148/284] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/users/7ee78fdeb41a4396aface7093389f39b => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:52.001432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.028675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:52.033899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 137/285] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:40:51 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:52.040551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.129917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:52.157777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55f453-4831-488a-be14-04a49eedac5f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:52.166719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4aabb4-074c-4aad-a5d0-e14efa6d5810 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:52.221341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:52.221748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:52.222482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:52.222826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:52.223178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] PATH_INFO: `/v3/users/ede5b50d74d245c88037ef3235b747ea` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:52.223649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:52.224483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:52.225204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:52.228791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:52.229344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:52.231889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.247884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 149/286] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:52.248166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] RBAC: Authorizing `identity:get_user(user_id=ede5b50d74d245c88037ef3235b747ea)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:52.249154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.250443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.256358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 138/287] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/users/ede5b50d74d245c88037ef3235b747ea => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:52.256358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.365376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:52.441267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2ca0c-4bbd-4e30-9027-c39acb81a3e2 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:52.444546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62d2aa-5238-4ade-be43-bcbd7bc30b6a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:52.515609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:52.516518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:52.516949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:52.517391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:52.524726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:52.526256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:52.526707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:52.527148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] PATH_INFO: `/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:52.529168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] RBAC: Authorizing `identity:get_user(user_id=ecb79f5b5a014a49b78cb2b958b9a01b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:52.531762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.534766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 139/288] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:52.536284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.541928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:52.663697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:52.666517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.757667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab64da-2aff-475e-9d8a-48e7e99ae2f8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:52.817231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:52.833567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:52.838523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:52.838523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:52.838523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:52.838523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, user.id=ede5b50d74d245c88037ef3235b747ea, scope.system=all) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:52.838523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:52.842226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:52.852839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 140/289] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/role_assignments?user.id=ede5b50d74d245c88037ef3235b747ea&scope.system=all&role.id=fd19870371784c8facf151d36c77a6b5 => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:52.855033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:52.892309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 150/290] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:52.901080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:53.063906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:53.109303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f50ea-2508-4dd1-b6ca-a1e3bd1add3d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:53.195299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:53.196479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:53.196943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:53.197422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:53.206543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:53.209360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:53.222693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 141/291] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:53.228698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:53.254873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad19f7-4860-48bd-8495-9b55d984e61c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:53.338555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:53.338555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:53.338976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:53.340681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:53.349166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:53.350699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:53.352760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 151/292] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:52 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:53.361621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:53.413609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:53.556144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df334a-18fc-43d8-a2fe-15961b34b77d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:53.709288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5e2b7-3c8c-41d6-b8eb-1d6399142a26 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:53.716144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:53.717318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:53.717786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:53.718254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/users/ecb79f5b5a014a49b78cb2b958b9a01b/roles/bc67532bb5de43a08d508df3b68e57a4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:53.727297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, user_id=ecb79f5b5a014a49b78cb2b958b9a01b, role_id=bc67532bb5de43a08d508df3b68e57a4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:53.730038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e76fc-2c59-4201-9889-72d23fef97f5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:53.763361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:53.767201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:53.768866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:53.769408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:53.769877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:53.770887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=7ee78fdeb41a4396aface7093389f39b) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:53.771465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:53.773196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66813c-d787-40aa-8922-0d2c6b974d5c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:53.780998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 152/293] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:53 2022] GET /identity/v3/role_assignments?user.id=7ee78fdeb41a4396aface7093389f39b&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=fd19870371784c8facf151d36c77a6b5 => generated 608 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:53.846073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 142/294] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:40:53 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/users/ecb79f5b5a014a49b78cb2b958b9a01b/roles/bc67532bb5de43a08d508df3b68e57a4 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:40:55.238202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981790c1-bed9-452d-b869-a6fecc6c386a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.238729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981790c1-bed9-452d-b869-a6fecc6c386a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.238729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981790c1-bed9-452d-b869-a6fecc6c386a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.240276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 153/295] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:55.246230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d01-18d5-442c-ac6c-f552c086dff7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.247195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d01-18d5-442c-ac6c-f552c086dff7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.247710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa314d01-18d5-442c-ac6c-f552c086dff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.268026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aa314d01-18d5-442c-ac6c-f552c086dff7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:55.269773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aa314d01-18d5-442c-ac6c-f552c086dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:55.349904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 143/296] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:55.564925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fad30-fa0b-4b3a-af2f-fc992cdf1c8a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.565210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fad30-fa0b-4b3a-af2f-fc992cdf1c8a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.565487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fad30-fa0b-4b3a-af2f-fc992cdf1c8a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.567279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 154/297] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:55.575615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.575892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.576184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.597285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:55.597856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0998d-119c-4e82-8e30-6c850d9af80f None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.598141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0998d-119c-4e82-8e30-6c850d9af80f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.598412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0998d-119c-4e82-8e30-6c850d9af80f None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.598593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:55.600237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 155/298] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:55.607402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.607802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.608716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.634059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:55.635850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:55.658756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:55.688953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 144/299] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:55.692355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:55.726546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 156/300] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:55.854625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42cbe4-68ab-4c1b-a443-57b3cafb50bf None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:55.933173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:55.934673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:55.935429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:55.936144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:55.938678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:55.942481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:55.946572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 145/301] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:40:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:55.958075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.013099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.094062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:56.110165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f72f9-0bd5-47d8-bc58-74282cb454e8 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.114886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:56.155788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.156909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.157192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.157463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] PATH_INFO: `/v3/groups` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.158455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:56.159943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:56.172749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d67433-d9cb-4040-b349-b15449d5191e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.233769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.234432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.234710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.234980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.247761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:56.253114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:56.254147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 146/302] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:56.255779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.270245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 157/303] 10.222.0.96 () {60 vars in 1134 bytes} [Thu Sep 8 13:40:55 2022] POST /identity/v3/groups => generated 229 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:56.270245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.431594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf9b13-a1ef-4970-a4e0-a0797713ac51 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.442502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:56.454562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55c42-48ca-4d4d-8503-76a3459fda3c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.492394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.493738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.494370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.494986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.511295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.512130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.513054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.513411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.514184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:56.514623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:56.516144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:56.519687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:56.532157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 158/304] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:56.532436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:56.533977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:56.535533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 147/305] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:56.541379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.542033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.600752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:56.720500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c92df-2cfc-4d11-8e07-0575e31fb93e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.733059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b105b-341c-434e-919c-062b7602fda0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:56.768586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.769648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.770146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.770617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] PATH_INFO: `/v3/users/ede5b50d74d245c88037ef3235b747ea` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.772195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] RBAC: Authorizing `identity:get_user(user_id=ede5b50d74d245c88037ef3235b747ea)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:56.774007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:56.776341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 159/306] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/users/ede5b50d74d245c88037ef3235b747ea => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:56.788307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.828640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:56.830178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:56.830650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:56.831162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:56.832817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:56.833370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:56.837060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:56.859689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 148/307] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:56.867151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:56.941187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:57.025932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:57.047124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae7a97-a9c5-4a51-a436-85484a8763c8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:57.099016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69cfde-1075-40f0-a44b-9afa5dc122c5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:57.110790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:57.111589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:57.111954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:57.112334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] PATH_INFO: `/v3/system/users/ede5b50d74d245c88037ef3235b747ea/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:57.114029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ede5b50d74d245c88037ef3235b747ea, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:57.115535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff2aad-fe6e-4244-a16a-cc3c3e32ecc0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:57.173832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:57.175317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:57.176077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:57.176832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] PATH_INFO: `/v3/users/73c372566d624efa94653a4f35372e80` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:57.202785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] RBAC: Authorizing `identity:get_user(user_id=73c372566d624efa94653a4f35372e80)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:57.206503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:57.210029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 149/308] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:56 2022] GET /identity/v3/users/73c372566d624efa94653a4f35372e80 => generated 293 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:57.216948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:57.319479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:57.338843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bbdc7-b786-42f1-b1d9-723902cd6544 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:57.380501 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:57.381131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:57.381413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:57.381688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:57.382428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, user.id=73c372566d624efa94653a4f35372e80, scope.system=all) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:57.382740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:57.384456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e39bd-0990-43fb-b921-2315df0edc4a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:57.390915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 150/309] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Sep 8 13:40:57 2022] GET /identity/v3/role_assignments?user.id=73c372566d624efa94653a4f35372e80&scope.system=all&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:57.437407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 160/310] 10.222.0.96 () {58 vars in 1334 bytes} [Thu Sep 8 13:40:56 2022] PUT /identity/v3/system/users/ede5b50d74d245c88037ef3235b747ea/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:40:57.509070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35594f9-a1ad-4ae0-84b0-376ef1f3bc4d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:57.509574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35594f9-a1ad-4ae0-84b0-376ef1f3bc4d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:57.510079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35594f9-a1ad-4ae0-84b0-376ef1f3bc4d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:57.513343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 151/311] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:57.523398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:57.523898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:57.524426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:57.559739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:57.562013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:57.654919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 161/312] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:58.160770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35594f9-a1ad-4ae0-84b0-376ef1f3bc4d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:58.325146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35594f9-a1ad-4ae0-84b0-376ef1f3bc4d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:58.371503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:58.372196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:58.372495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:58.372803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:58.397618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:40:58.405944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:58.410525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:40:58.422573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 152/313] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:58.431284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:58.642601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:58.665799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222565b-458c-4fb9-8f5e-60414a9a6b18 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:58.738842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:58.739694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:58.740151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:58.740649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:58.741957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:58.742489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:58.745082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:58.762680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 162/314] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:58.772518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:58.799749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:58.993193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d223c2-b5ba-424c-89d3-3fe7b1575dc2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:59.062405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:59.063427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.063901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.064398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] PATH_INFO: `/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.067010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] RBAC: Authorizing `identity:get_user(user_id=ecb79f5b5a014a49b78cb2b958b9a01b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:59.070049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5fa53-ec7c-46f9-905b-946c59225255 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:59.073392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 153/315] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:40:58 2022] GET /identity/v3/users/ecb79f5b5a014a49b78cb2b958b9a01b => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:59.085763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:59.265757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bac2a2-4ac8-405c-a587-59a615353bc6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:59.306776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:59.307404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.307732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.308016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.331484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:59.413572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:59.416410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:59.577615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490562bb-04f5-4a54-95e7-e48a35418b91 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.578134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490562bb-04f5-4a54-95e7-e48a35418b91 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.578134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490562bb-04f5-4a54-95e7-e48a35418b91 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.580023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 154/316] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:59.586093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06186-ae67-45a8-babf-9bbb97bb7369 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.586442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06186-ae67-45a8-babf-9bbb97bb7369 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.586720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a06186-ae67-45a8-babf-9bbb97bb7369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.608323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-96a06186-ae67-45a8-babf-9bbb97bb7369 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:59.609751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-96a06186-ae67-45a8-babf-9bbb97bb7369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:59.628650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 163/317] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:59.634838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:59.708398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:59.739846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 155/318] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:40:59.809158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531fd26f-dc25-4b4c-ab58-9bb7d8cc89c8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:59.842016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de7e0-dee8-4ba0-8d1a-462356829f52 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.842247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de7e0-dee8-4ba0-8d1a-462356829f52 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.842563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001de7e0-dee8-4ba0-8d1a-462356829f52 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.844243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 156/319] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:40:59.850517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.850806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.851141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.872595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:59.873894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:59.877481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:59.890106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:59.891411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:59.891897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:59.893633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:59.896602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:59.900043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:59.906221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 164/320] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:40:59 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:40:59.916712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:59.993852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 157/321] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:00.068960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aafe0-8549-49a9-b2ca-839402b50c12 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.090732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:00.101535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.126220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.127830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.128893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.129388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.130835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, scope.project.id=5f45ed4141604b07a48ead91119799ec, user.id=ecb79f5b5a014a49b78cb2b958b9a01b) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:00.131408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:00.134621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7f3b9-b835-4892-9c5e-1d97e7dad08e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:00.145168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 165/322] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:40:59 2022] GET /identity/v3/role_assignments?user.id=ecb79f5b5a014a49b78cb2b958b9a01b&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:00.146492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e91a-d798-495f-a2e2-4b4a022ff4a5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.146773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e91a-d798-495f-a2e2-4b4a022ff4a5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.147047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33e91a-d798-495f-a2e2-4b4a022ff4a5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.148650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 166/323] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:00.154382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.154699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.154927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.178874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:00.181028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:00.235846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d800ff-5cfd-47de-8f5b-e5f5695dcdfe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.279104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.279769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.280123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.280450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.281834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:00.284047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:00.286024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 158/324] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:00.286726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.294907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 167/325] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:00.296249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.303194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:00.423212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d3d7b-dbc2-4cec-b6f1-1f0c2e136f18 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.435072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c38264-8b0c-40d6-988b-7c3e01da113e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.440534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:00.467526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.468153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.468550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.468837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] PATH_INFO: `/v3/groups` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.469549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:00.471843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:00.483030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.483689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.483956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.484269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.501006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:00.507127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:00.508065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:00.509656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 159/326] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:00.514566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.572147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 168/327] 10.222.0.96 () {60 vars in 1134 bytes} [Thu Sep 8 13:41:00 2022] POST /identity/v3/groups => generated 226 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:00.591924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.630486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:00.695610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0f8ba-8fd1-4655-a373-05123b035450 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.748259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f0657-030a-484e-aaeb-e2cf428f78a4 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.751003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.751662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.751951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.752892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.753890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:00.754403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:00.756129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:00.769730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 160/328] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:00.774823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.801004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:00.801657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:00.801933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:00.802203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:00.817562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:00.823489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:00.825121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:00.826170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 169/329] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:00.832035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:00.886286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:00.937639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18e270-badb-4f9c-afee-bba990c5af32 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:00.986717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:01.001411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:01.002701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:01.002887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:01.003587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] PATH_INFO: `/v3/users/73c372566d624efa94653a4f35372e80` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:01.005684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] RBAC: Authorizing `identity:get_user(user_id=73c372566d624efa94653a4f35372e80)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:01.008183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:01.010949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 161/330] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/users/73c372566d624efa94653a4f35372e80 => generated 293 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:01.020018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:01.024881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85047e-9d94-4a87-bd19-c3d04b2f6dfd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:01.093030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:01.094027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:01.094636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:01.095153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:01.096616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:01.097200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:01.098941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:01.114409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 170/331] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:01.120057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:01.224430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fe3b4-29b9-45c2-a208-c46f5fb6c436 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:01.272563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:01.273656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:01.274177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:01.274675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] PATH_INFO: `/v3/system/users/73c372566d624efa94653a4f35372e80/roles/bc67532bb5de43a08d508df3b68e57a4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:01.278526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=73c372566d624efa94653a4f35372e80, role_id=bc67532bb5de43a08d508df3b68e57a4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:01.280458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:01.311439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:01.321613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25729fe5-8ece-48e2-84b9-7ad0a4f57ccc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:01.381504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 162/332] 10.222.0.96 () {58 vars in 1334 bytes} [Thu Sep 8 13:41:01 2022] PUT /identity/v3/system/users/73c372566d624efa94653a4f35372e80/roles/bc67532bb5de43a08d508df3b68e57a4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:41:01.389673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:01.390817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:01.391345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:01.391812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] PATH_INFO: `/v3/users/ede5b50d74d245c88037ef3235b747ea` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:01.394672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] RBAC: Authorizing `identity:get_user(user_id=ede5b50d74d245c88037ef3235b747ea)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:01.397466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674d06-ca14-46fe-86b5-1ba436bb4462 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:01.400730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 171/333] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:41:01 2022] GET /identity/v3/users/ede5b50d74d245c88037ef3235b747ea => generated 293 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:01.410364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:01.532870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:01.627790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6d8e2-2f26-45fe-a375-f7f84b6189ef None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:01.707711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:01.708769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:01.709237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:01.709763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:01.711130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] RBAC: Adding query filter params (role.id=fd19870371784c8facf151d36c77a6b5, user.id=ede5b50d74d245c88037ef3235b747ea, scope.system=all) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:01.711646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:01.714620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea28ba-b193-4b1a-9720-852c347aeca5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:01.741888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 163/334] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Sep 8 13:41:01 2022] GET /identity/v3/role_assignments?user.id=ede5b50d74d245c88037ef3235b747ea&scope.system=all&role.id=fd19870371784c8facf151d36c77a6b5 => generated 510 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:03.218199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630ba67-0b7c-402d-bb81-05c3e8708155 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:03.218787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630ba67-0b7c-402d-bb81-05c3e8708155 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:03.219189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630ba67-0b7c-402d-bb81-05c3e8708155 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:03.222264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 172/335] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:03.229669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:03.230195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:03.230588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:03.279412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:03.281544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:03.468935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 164/336] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:04.436978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630ba67-0b7c-402d-bb81-05c3e8708155 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:04.572280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630ba67-0b7c-402d-bb81-05c3e8708155 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:04.662924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:04.664141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:04.664563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:04.665022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:04.698489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-9eabf579-e866-48a0-9d32-4feef6296863 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:04.709297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:04.710357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:04.711160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:04.711839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 173/337] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:04.721719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:04.826236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:04.901087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0253ab0-4815-41fa-b87e-2654798dc0b6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:04.955253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:04.955824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:04.956100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:04.956432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:04.957295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:04.957594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:04.959100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:04.971477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 165/338] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:04.980596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c9d-b6a1-41c8-bcfd-9c4e2daebeef None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:04.981018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c9d-b6a1-41c8-bcfd-9c4e2daebeef None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:04.981389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce3c9d-b6a1-41c8-bcfd-9c4e2daebeef None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:04.984352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 174/339] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:04.987941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:04.993626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:04.994124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:04.994710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:05.055296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:05.057494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:05.112341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:05.119358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe9f1c-e8da-4426-bc13-99b20562bdf2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:05.136745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:05.197033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:05.197671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:05.197945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:05.198216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:05.240345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 175/340] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:05.357383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:05.360257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:05.617331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 166/341] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:05.626739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:05.751366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:05.792774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:05.898315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1aeb70-06e7-4124-a08b-820dc8fcb95e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.016813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.018473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.018968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.019439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.021782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:06.024628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:06.032381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 176/342] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:05 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:06.035958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770cf66-4247-468f-9d5e-a8a9f5d5db55 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.037855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:06.112268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:06.147011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.148085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.148665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.149093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.183036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1bc6de32-dc8f-465b-8ca1-94551945e885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:06.197468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:06.198528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:06.199910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 167/343] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:06.202147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80062bc-8e19-4006-acf5-15f1c2ff7703 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.202650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80062bc-8e19-4006-acf5-15f1c2ff7703 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.203142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80062bc-8e19-4006-acf5-15f1c2ff7703 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.210315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 168/344] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:06.211671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80062bc-8e19-4006-acf5-15f1c2ff7703 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:06.324273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e66ec-5805-4558-ac61-706466244126 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.376724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:06.409732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.410780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.411465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.416279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.431772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80062bc-8e19-4006-acf5-15f1c2ff7703 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.436222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:06.438870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f77ad-206e-483d-a400-7a1a1e959e43 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:06.443379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 177/345] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:06 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:06.450450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d431-a9a5-4a8f-b847-a26301e2ecab None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.451054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d431-a9a5-4a8f-b847-a26301e2ecab None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.451579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32d431-a9a5-4a8f-b847-a26301e2ecab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.479643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.481896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.482449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.483030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.483994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:06.485334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:06.487159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146042a-8fbb-4a98-b602-05b129b7c815 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:06.494690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-cb32d431-a9a5-4a8f-b847-a26301e2ecab None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:06.496982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cb32d431-a9a5-4a8f-b847-a26301e2ecab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:06.498638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 169/346] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:06.500159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4f14-5782-47db-b360-bd6b879f4d48 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.500714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4f14-5782-47db-b360-bd6b879f4d48 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.501611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db4f14-5782-47db-b360-bd6b879f4d48 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.504183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 170/347] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:06.505332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db4f14-5782-47db-b360-bd6b879f4d48 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:06.660566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db4f14-5782-47db-b360-bd6b879f4d48 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.679545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 178/348] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:06.682597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.688277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.688856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.702882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:06.709300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.710387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.710978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.711595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:06.712743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=a27997214a454ab9a0febb5bf21c27b5) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:06.713281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:06.717755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:06.727150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 171/349] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:06 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=fd19870371784c8facf151d36c77a6b5 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:06.731542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:06.764329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:06.772855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:06.803966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:06.865153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bac397-dfc1-4d23-b601-c43ec2be6076 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:06.908032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:06.908972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:06.909386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:06.909726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:07.008509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 179/350] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:07.024930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:07.054221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:07.057149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4016a5e9-0427-43e7-b8ec-98fc5a8762f7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:07.317588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 172/351] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:07.325529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:07.572461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084af4-fd50-4c30-a32b-70f9cbfd4766 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:07.572926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084af4-fd50-4c30-a32b-70f9cbfd4766 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:07.573425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e084af4-fd50-4c30-a32b-70f9cbfd4766 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:07.576046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 173/352] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:07.584415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:07.586024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:07.586932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:07.600328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7722c-f03c-4173-919c-d525572cd788 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:07.638938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:07.642074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:07.712131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:07.714776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:07.716404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:07.717164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:07.720735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:07.724836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:07.729699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 180/353] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:07 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:07.736812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:07.781862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:07.844406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 174/354] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:07.848280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:07.936624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:08.071292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b43c4-ea65-4d6f-b9ad-0adad5a5a996 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.155667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.156276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.156565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.156843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.166380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cb6f8-756d-47eb-99a9-e4ae337f9cdd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.183147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:08.193276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:08.194304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:08.195101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:08.198755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 181/355] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:08.198755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:08.232349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.234184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.234673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.235504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.260046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3b537ee4-bdf5-47ba-945b-9aee4bdd3484 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:08.270812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:08.271793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:41:08.272700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:08.273286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 175/356] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:08.276280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a076a-ec61-48e5-a45d-f3a8cc9fcf06 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.277010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a076a-ec61-48e5-a45d-f3a8cc9fcf06 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.277543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a076a-ec61-48e5-a45d-f3a8cc9fcf06 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.281383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 176/357] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:08.284802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a076a-ec61-48e5-a45d-f3a8cc9fcf06 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:08.327351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:08.360616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb5db8-0c5d-4715-840d-ee6660030d3b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.423751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.424452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.424737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.425012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.426270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:08.427757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:08.430581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 182/358] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:08.431283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:08.463770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:08.507563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a076a-ec61-48e5-a45d-f3a8cc9fcf06 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.583792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.583792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.583792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.583792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.584430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:08.584568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:08.587584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92434d29-a437-4090-b59d-b8ec39039e83 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:08.597799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 177/359] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:08.599156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.599442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.599712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.622113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ba760-6bbf-4815-a5df-f6bbba4877f7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.627038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:08.628952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:08.682449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.682974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.683255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.683531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.684336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:08.684571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:08.686015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:08.697933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 183/360] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:08.698320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:08.708976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:08.740796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 178/361] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:08.741788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:08.868334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:08.897750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a26be-37b6-4cc1-a137-4876c0db359f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.909268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0e0a-7054-4d34-b2c5-6a227bf6480f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:08.951737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:08.952623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:08.952623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:08.952928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:08.953763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=a27997214a454ab9a0febb5bf21c27b5) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:08.954143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:08.955719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:08.962688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 179/362] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=21008fb2299d4f8cba069e6c99468411 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:08.963723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.018088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.023378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.024376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.025157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.056843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:09.064173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:09.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 184/363] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:09.068574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.173200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:09.232568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886946-fb68-488c-99c8-11dc44e6577e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:09.274644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4418324-9fd8-455f-8c0d-8ed6d64881e5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:09.299030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.301130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.301909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.302836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] PATH_INFO: `/v3/users/73c372566d624efa94653a4f35372e80` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.305547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] RBAC: Authorizing `identity:get_user(user_id=73c372566d624efa94653a4f35372e80)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:09.308719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:09.312520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 185/364] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:41:09 2022] GET /identity/v3/users/73c372566d624efa94653a4f35372e80 => generated 293 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:09.314459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.361361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.362435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.363376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.363863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.387890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:09.512947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:09.516533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:09.554162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86d3b0-4a37-4fe6-82f1-d8b4f2b96793 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:09.633228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:09.634195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.639571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.639571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.639571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.653954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:09.661013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:09.663012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:09.664579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:09.668932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 186/365] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:09.670976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.710490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 180/366] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:09.711415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.769910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:09.841623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0188e1a-88e9-439b-9590-88784100fc9a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:09.896795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.897538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.897836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.898160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.898941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] RBAC: Adding query filter params (role.id=bc67532bb5de43a08d508df3b68e57a4, user.id=73c372566d624efa94653a4f35372e80, scope.system=all) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:09.899248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:09.900822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:09.907040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375d226-dbd4-4178-8aae-61e94fe9d0cb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:09.922094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 181/367] 10.222.0.96 () {56 vars in 1308 bytes} [Thu Sep 8 13:41:09 2022] GET /identity/v3/role_assignments?user.id=73c372566d624efa94653a4f35372e80&scope.system=all&role.id=bc67532bb5de43a08d508df3b68e57a4 => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:09.923146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:09.990938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:09.993416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:09.994554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:09.996484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:09.998255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:09.999057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:10.004311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:10.029156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 187/368] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:10.032194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:10.123225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.145146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.148810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e797f8-4ff9-44f7-a7d0-3ce3a8fd96d8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:10.207553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f133-a57d-4ade-bb67-5b408e20d5f0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:10.223884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:10.225401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:10.225401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:10.225706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:10.226328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:10.226634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:10.228131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:10.241211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 182/369] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:10.242214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:10.288891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:10.290730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:10.291038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:10.292790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:10.295201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:10.297928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:10.302885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 188/370] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:10 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:10.306860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:10.474643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9b7ba-3063-412a-b8d7-bc466ce92399 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:10.483530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a69d-4d02-4a60-beb9-a627bff3e856 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:10.511844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.531230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:10.531938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:10.532247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:10.532568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:10.545066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:10.546623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:10.547402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:10.548176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:10.613552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.635655 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:10.637411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:10.697454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:10.700873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cde4a0-a90f-44eb-be4a-9193c266d4bc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:10.787244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 189/371] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:10.788144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:10.838380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.924089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 183/372] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:10.925622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def1a7-5ce1-43c8-a8cd-86fb16f0dd58 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:10.925902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def1a7-5ce1-43c8-a8cd-86fb16f0dd58 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:10.926216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def1a7-5ce1-43c8-a8cd-86fb16f0dd58 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:10.932381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 184/373] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:10.932381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def1a7-5ce1-43c8-a8cd-86fb16f0dd58 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.001021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eb813-50e9-4a30-975c-aa7bd98b3a20 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.059208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.060273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.060699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.061111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.062539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.064102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:11.065652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.068347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 190/374] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:10 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.069410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.130157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def1a7-5ce1-43c8-a8cd-86fb16f0dd58 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.195131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.197373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.197668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.197912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] PATH_INFO: `/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.199572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] RBAC: Authorizing `identity:get_project(project_id=2f9a4c439d9e4fb8b5b20ab81fd61ef3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.204259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b943e-dae8-4be6-a4e2-0da54c6b0a66 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.204259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 185/375] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:10 2022] GET /identity/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3 => generated 344 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.207203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.207203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.207203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.230298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:11.244496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:11.247399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d250048-2a6d-4e46-b64c-f86ca31d17fc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.247578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:11.290355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.291017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.291299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.291617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.292965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.294533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.296942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 191/376] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.297884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.397567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 186/377] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:11.397567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.456453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242f342-4888-4415-af7c-eea5d4e6ffdd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.501096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.502108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.503147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.503619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.504623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=5f45ed4141604b07a48ead91119799ec) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:11.505168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.507023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.514947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 192/378] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=fd19870371784c8facf151d36c77a6b5 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.516326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.520568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:11.563820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:11.610382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9e25a-14f2-4404-b9ca-a873b33eebda None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.667277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13a4f9-0c19-4f03-9481-199d3fea6f6d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.690131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.691878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.692760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.693564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] PATH_INFO: `/v3/groups/5369664eb8734342a050a55e98855f3b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.709988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.710743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.711096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.711372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.712185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] RBAC: Authorizing `identity:get_group(group_id=5369664eb8734342a050a55e98855f3b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.712744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.714251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.715849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.716746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 193/379] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.719722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 187/380] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/groups/5369664eb8734342a050a55e98855f3b => generated 229 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.726925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.730311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:11.843809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:11.859758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca1a69-4637-4578-bef6-81b2434a81db None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.904684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:11.905773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:11.906414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:11.906890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:11.907888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] RBAC: Adding query filter params (group.id=5369664eb8734342a050a55e98855f3b, role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=2f9a4c439d9e4fb8b5b20ab81fd61ef3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:11.908486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:11.910917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b64de-2a4b-49e2-9bac-62b44343f4f8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:11.918391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 194/381] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/role_assignments?group.id=5369664eb8734342a050a55e98855f3b&scope.project.id=2f9a4c439d9e4fb8b5b20ab81fd61ef3&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:11.947300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52517220-6bbb-47e4-80bb-e7ce40363303 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:11.997864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:12.017102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:12.018022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:12.018958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:12.019368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:12.020593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=5f45ed4141604b07a48ead91119799ec) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:12.021137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:12.023951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ccee7-bf5e-40b1-afce-4d4d09926098 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:12.035851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 188/382] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:11 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=21008fb2299d4f8cba069e6c99468411 => generated 260 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:12.190656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de123-1bfa-490e-90a4-c8fb05f3ebc1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:12.191706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de123-1bfa-490e-90a4-c8fb05f3ebc1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:12.192276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2de123-1bfa-490e-90a4-c8fb05f3ebc1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:12.194017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 195/383] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:41:12.201288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:12.201811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:12.202262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:12.222498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de123-1bfa-490e-90a4-c8fb05f3ebc1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:12.254566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:12.256960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:12.355378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2de123-1bfa-490e-90a4-c8fb05f3ebc1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:12.401530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:12.402802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:12.404150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:12.404859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:12.433717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:12.441920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:12.443068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:12.444316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:12.447370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 196/384] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:12.457499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:12.478217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:12.503453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 189/385] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:12.654667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def0ec-59d5-46ec-951c-ae423eb69bfa None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:12.732962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:12.733863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:12.734347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:12.734835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:12.736094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] RBAC: Adding query filter params (name=member) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:12.736658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:12.739796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:12.764393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 197/386] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:12.773504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:12.821571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.011864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:13.055963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed2645-ab50-41a9-a9e7-bca73cda5f15 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.069910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b69d4-2d27-4b95-bd1f-4a58ff859d4d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.094482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:13.144732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.145811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.146286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.146760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.153661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.154326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.154609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.154888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.161103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:13.162707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:13.164973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 190/387] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:12 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:13.168345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:13.170882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:13.180137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:13.181961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:13.185312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 198/388] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:13.193821 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.404433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135d1b17-41b7-4997-9523-532cc7326ace None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.472822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.473890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.474356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.474822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.477241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:13.479915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:13.483243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 191/389] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:13 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:13.490202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.494297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ef1d3-790f-4389-b425-d8794caeaeeb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.621090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.621727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.622012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.622283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.622970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:13.623270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:13.624741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:13.626746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:13.641143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 199/390] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:13.650147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.698355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:13.829182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a9d9-1f52-482f-a3fe-120dd135a196 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.859515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781862d0-da67-4d80-9c90-adee381033f5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:13.901700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.902361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.902631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.902907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.904184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:13.905731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:13.907530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 200/391] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:13 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:13.921306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:13.929572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:13.930281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:13.930568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:13.930847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:13.941631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, group_id=b69f89ea68c14d5d99e1241a18fadd5c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:13.943168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:14.005911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:14.044787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b2956-5cae-4aaf-9769-9f165681bf85 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:14.059007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 192/392] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Sep 8 13:41:13 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:14.092223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:14.092903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:14.093180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:14.093457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:14.102200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:14.103762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233acbf0-896b-4621-bb41-76dcedf5f247 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:14.105652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 201/393] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:13 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:14.112094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:14.261228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0110-0576-4814-9e8c-f3fb19e2b29b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:14.279321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:14.304992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:14.305608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:14.305886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:14.306163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:14.308742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a27997214a454ab9a0febb5bf21c27b5, group_id=b69f89ea68c14d5d99e1241a18fadd5c, role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:14.310250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc33a-2f1f-4ba3-b578-489935a2a9c9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:14.421254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 193/394] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Sep 8 13:41:14 2022] PUT /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/21008fb2299d4f8cba069e6c99468411 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:41:14.985594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd1cb-cd25-4b02-8218-3610d1edf1a5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:14.986351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd1cb-cd25-4b02-8218-3610d1edf1a5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:14.986351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cd1cb-cd25-4b02-8218-3610d1edf1a5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:14.988093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 202/395] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:14.994193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf65642-9544-4417-b811-1625e52d9fcb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:14.994449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf65642-9544-4417-b811-1625e52d9fcb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:14.994769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf65642-9544-4417-b811-1625e52d9fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.021589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fcf65642-9544-4417-b811-1625e52d9fcb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:15.022862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fcf65642-9544-4417-b811-1625e52d9fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:15.132178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 194/396] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:15.325022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf840d-eb60-412d-8107-0831a22fa0c1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:15.325509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf840d-eb60-412d-8107-0831a22fa0c1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:15.325752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf840d-eb60-412d-8107-0831a22fa0c1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.326920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 203/397] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:15.342329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af10-a5c6-4b32-887b-4d76273c48e4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:15.342746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af10-a5c6-4b32-887b-4d76273c48e4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:15.343082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5af10-a5c6-4b32-887b-4d76273c48e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.366396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a2f5af10-a5c6-4b32-887b-4d76273c48e4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:15.367768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a2f5af10-a5c6-4b32-887b-4d76273c48e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:15.479234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 195/398] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:15.651803 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf840d-eb60-412d-8107-0831a22fa0c1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:15.789553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4382df-0154-4b94-9b63-7ef6cf27922e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:15.790419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4382df-0154-4b94-9b63-7ef6cf27922e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:15.791065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4382df-0154-4b94-9b63-7ef6cf27922e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.793718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 196/399] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:15.802886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:15.803745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:15.804566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.805450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf840d-eb60-412d-8107-0831a22fa0c1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:15.846938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:15.849458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:15.858363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:15.861082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:15.861951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:15.862947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:15.863224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:15.891122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:15.897730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:15.899487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:15.903825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 204/400] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:15.907943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:15.916616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:16.024681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 197/401] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:16.027118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.061826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df9328-2eae-4c83-8150-72a82de681bd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.112703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.112703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.112703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.112703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.113324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:16.113324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:16.113324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:16.142176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 205/402] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:16.150135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.296910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:16.323436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca976ab-c29d-4730-8b50-28909b64d6b7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.344312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbde1e-487b-43b5-bca5-d8b8745eb841 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.391081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.391741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.392018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.396794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.398962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:16.402837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:16.406764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 206/403] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:16.413414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.434107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.434767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.435041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.435316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.460145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:16.465291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:16.467303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:16.469477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 198/404] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:16.481942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.535546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:16.587661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7842586-f322-4ac3-ba94-b6516057c48f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.622106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:16.637739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.641261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.641261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.641261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.641261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:16.642700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:16.647154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 207/405] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:16.647154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.674999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadef94-7168-4bab-9ad6-39629432efb0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.749238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.750774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.751801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.754503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.756048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:16.756808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:16.760856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:16.779187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 199/406] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:16.780099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.816964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec110cb-2f57-453d-8794-859228d462c3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.886330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:16.893124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.894738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.895535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.896333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.905001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727f997-21e6-42ed-9ff1-8e7999c384ca None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:16.919378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:16.932573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:16.934316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:16.935908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:16.940273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 208/407] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:16.942246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:16.952947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:16.953635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:16.953915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:16.954189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:16.956795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, group_id=b69f89ea68c14d5d99e1241a18fadd5c, role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:16.958294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.038583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:17.074118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 200/408] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Sep 8 13:41:16 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/21008fb2299d4f8cba069e6c99468411 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:17.082987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:17.213744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44de4-2761-4967-8292-0668846c7efa None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:17.296951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4eee5-e7c0-4d83-aa93-bc627e03db4b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:17.314219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:17.314894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.315206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.315640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] PATH_INFO: `/v3/groups/5369664eb8734342a050a55e98855f3b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.316996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] RBAC: Authorizing `identity:get_group(group_id=5369664eb8734342a050a55e98855f3b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:17.318679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.324588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 209/409] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:16 2022] GET /identity/v3/groups/5369664eb8734342a050a55e98855f3b => generated 229 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:17.335826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:17.344650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:17.345323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.345682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.345860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.347179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:17.347487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:17.349062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.360247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 201/410] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:17.375383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:17.394196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:17.539595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0d30d-2bd9-4714-8d2c-1907ba944001 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:17.568719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be5a2-a452-4659-9c4f-e6fe83a8c78e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:17.585625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:17.586279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.586557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.587303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.588092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:17.589596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3fae9-e926-421c-95e9-355581432033 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 202/411] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:17 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f46-33cb-49a2-a283-7fbc76ee0730 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f46-33cb-49a2-a283-7fbc76ee0730 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97778f46-33cb-49a2-a283-7fbc76ee0730 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 203/412] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:17.596255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e3b27-d4ca-4680-b7bc-6692573ffa01 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.597292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e3b27-d4ca-4680-b7bc-6692573ffa01 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.597292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e3b27-d4ca-4680-b7bc-6692573ffa01 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.598126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 204/413] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:17.598892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e3b27-d4ca-4680-b7bc-6692573ffa01 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:17.609212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:17.633220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:17.634213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.634765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.634873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] PATH_INFO: `/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.636850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=2f9a4c439d9e4fb8b5b20ab81fd61ef3)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:17.639471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6538cc-e740-469d-b094-c5fada710fc9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.650278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 210/414] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:17 2022] GET /identity/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3 => generated 344 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:17.650278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172ed3-cdac-4f23-a986-019db6ae32bb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.650278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172ed3-cdac-4f23-a986-019db6ae32bb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.650278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23172ed3-cdac-4f23-a986-019db6ae32bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.684349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-23172ed3-cdac-4f23-a986-019db6ae32bb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:17.687068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-23172ed3-cdac-4f23-a986-019db6ae32bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:17.754490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:17.790231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e3b27-d4ca-4680-b7bc-6692573ffa01 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:17.820066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 211/415] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:17.820066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.820066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.820066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.844559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:17.847007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:17.872115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:17.873490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:17.874074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:17.874652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:17.877057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:17.879973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:17.883068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 205/416] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:17 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:17.884498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.045712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 212/417] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:18.047473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.152386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:18.154659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de61b5-ea5f-47b1-8575-317a4a5b7307 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:18.234384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:18.235471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:18.235974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:18.236515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] PATH_INFO: `/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3/groups/5369664eb8734342a050a55e98855f3b/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:18.240779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] RBAC: Authorizing `identity:create_grant(project_id=2f9a4c439d9e4fb8b5b20ab81fd61ef3, group_id=5369664eb8734342a050a55e98855f3b, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:18.243839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:18.258273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b01ca-147e-498f-82bb-526622019a48 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:18.310234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:18.311280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:18.311769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:18.312300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:18.315979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f45ed4141604b07a48ead91119799ec, group_id=b69f89ea68c14d5d99e1241a18fadd5c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:18.319105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:18.325971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 206/418] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Sep 8 13:41:17 2022] PUT /identity/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3/groups/5369664eb8734342a050a55e98855f3b/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:18.327598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.332529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:18.455415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 213/419] 10.222.0.96 () {58 vars in 1442 bytes} [Thu Sep 8 13:41:18 2022] PUT /identity/v3/projects/5f45ed4141604b07a48ead91119799ec/groups/b69f89ea68c14d5d99e1241a18fadd5c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:18.462437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e46029-f0c0-417e-a70c-cd64f3b0d533 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:18.516089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:18.517808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:18.518750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:18.519551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:18.556806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:18.569993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:18.574096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:18.575866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:18.577506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:18.582193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 207/420] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:18.593592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.757983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:18.794620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f212c3c-ae35-4a1e-8312-78f865e3e1e0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:18.807477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:18.826557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5629e-56b2-44d2-9bf0-0313a6be9f4f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:18.849472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:18.850125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:18.850391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:18.850661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:18.871122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:18.883421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:18.890487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:18.892441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:18.894176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:18.894330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 214/421] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:18.894454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:18.899691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:18.908254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 208/422] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:18.913865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:19.144044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910ac24-ba16-4978-b56b-23502179ae9c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:19.151749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05d209-fe5f-43a7-9b92-c4a448fad750 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:19.211439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:19.231875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:19.232710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:19.233000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:19.233272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:19.243697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:19.244352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:19.244615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:19.244997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:19.245693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:19.245999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:19.247405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:19.272096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 215/423] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:19.289991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:19.360571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:19.362082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:19.413557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:19.566921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 209/424] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:19.578066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:19.609613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be898a9d-6612-4b78-b0eb-d78eafc9fb8b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:19.637533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:19.709151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:19.709651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:19.709938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:19.710232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:19.816360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:19.817858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:19.834224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f381ea2-cd6c-4993-969b-ea98678536e5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:19.895990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:19.951483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:19.952657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:19.953143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:19.953625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:19.962077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:19.964852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:19.976411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 210/425] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:19 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:19.983929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:20.120994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 216/426] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:20.127644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:20.219963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:20.228147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822c1dc-e63f-4acc-926b-588c62cb88b8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:20.329952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:20.330846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.331777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.332164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.337874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:20.340721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:20.344322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 211/427] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:19 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:20.355296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:20.417369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caab64e-9426-475d-8783-895cd9f9f60b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:20.487161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:20.496665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:20.497311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.497584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.497854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] PATH_INFO: `/v3/projects/a27997214a454ab9a0febb5bf21c27b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.499084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] RBAC: Authorizing `identity:get_project(project_id=a27997214a454ab9a0febb5bf21c27b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:20.500705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3839a92-f997-402c-b842-a4c68dfa947a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:20.502791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 217/428] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:20 2022] GET /identity/v3/projects/a27997214a454ab9a0febb5bf21c27b5 => generated 298 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:20.504905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c7d7-211f-45c5-a56b-97acb8558127 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.505188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c7d7-211f-45c5-a56b-97acb8558127 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.505461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158c7d7-211f-45c5-a56b-97acb8558127 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.508450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 218/429] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:20.513290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.513290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.513674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.536292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:20.537636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:20.571270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fabd9e-baf2-490c-b0fe-3fe9cf269447 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:20.626467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:20.627463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.628511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.628726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 219/430] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:20.629227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.629742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:20.630421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=a27997214a454ab9a0febb5bf21c27b5) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:20.630941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:20.633038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:20.641894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 212/431] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:20 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=fd19870371784c8facf151d36c77a6b5 => generated 611 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:20.823515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24765ddf-8bef-477c-b691-96f219716ce0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:20.863288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:20.890067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:20.891441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:20.891994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:20.892510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:20.895391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:20.898348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:20.905022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 220/432] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:20 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:20.914057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:20.990432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:21.093328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:21.145297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbcb73-7522-4b82-ad3d-4389cf012ffb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:21.223110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:21.223768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.224050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.224361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.225154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=a27997214a454ab9a0febb5bf21c27b5) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:21.225461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:21.227015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:21.240626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 213/433] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:20 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=a27997214a454ab9a0febb5bf21c27b5&role.id=21008fb2299d4f8cba069e6c99468411 => generated 611 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:21.262948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae0cb0-6d85-4c95-8a8a-20f1bcfe2b88 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:21.319509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:21.320174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.320487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.320760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.338724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-2232f51d-67f0-4e17-82f1-32247771e97e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:21.348855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:21.349780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:21.350559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:21.351504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 221/434] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:21.357500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:21.494742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f5f2f-5447-4d95-8451-d473483a30be None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.495467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f5f2f-5447-4d95-8451-d473483a30be None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.495627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f5f2f-5447-4d95-8451-d473483a30be None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.498090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 222/435] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:21.508108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.508521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.508656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.517624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:21.538737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eef710-74e3-498f-a7d8-7d6e8adf93df None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:21.545976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:21.548073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:21.590686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:21.591985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.592303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.592569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.593341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:21.593703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:21.595259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:21.608830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 214/436] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:21.616574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:21.652689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:21.690378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 223/437] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:21.802425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b06f9-937b-4f54-a03f-b59debfd48d2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:21.875311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:21.875311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:21.875311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:21.875311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:21.920005 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.000113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.013335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.014881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efa802-ab9b-4487-9488-f086a528d870 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.142182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565adc-7624-4fe1-bde1-7d8afbaf2b12 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.148862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 215/438] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:22.150916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92e81-f25c-4a4a-9375-7405604c6687 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.151213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92e81-f25c-4a4a-9375-7405604c6687 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.151514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b92e81-f25c-4a4a-9375-7405604c6687 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.154126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 216/439] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:22.156550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92e81-f25c-4a4a-9375-7405604c6687 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.188898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.189718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.190151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.190537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.203272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-27aab151-aae0-4dba-ae63-aab4cc9de01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:22.208643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:22.209899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:22.210851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 224/440] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:22.211518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.211583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.211854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.235318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:22.236828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:22.238689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.297236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.310492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b92e81-f25c-4a4a-9375-7405604c6687 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.332396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 225/441] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:22.333265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.357056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.358159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.358529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.358773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.360043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.362924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.365058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 217/442] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:22.370914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.485435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81e7ba-1f62-404f-ac55-20747e8ec7a0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.509200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff4262-a9c0-4f46-ae98-fab7a3922b01 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.529850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.530793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.531246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.531639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.532725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:22.533162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.535421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.536863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.551770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 226/443] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:22.553023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.567781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.569085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.569526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.570013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.571819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.574023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.576913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 218/444] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:22.585505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.593221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.669032 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc956-385a-43e6-95e7-c2f47e425e1f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.723339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.724371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.724853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.725332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.726970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fdf4a-d000-4425-b821-884e960cb9f8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:22.770712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:22.771377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:22.771663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:22.771937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:22.772716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=5f45ed4141604b07a48ead91119799ec) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:22.773175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.774461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.792239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 219/445] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=21008fb2299d4f8cba069e6c99468411 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:22.847166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:22.848378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:22.856361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:22.895232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:22.950818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.028396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 227/446] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:23.028648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e89f37-3636-4147-b7ae-07865190fdc5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.032372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.091666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.092623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.092900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.093172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.106391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:23.112283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:23.114601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:23.116243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 220/447] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:23.120872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.187760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ea3f1-9225-4dba-a2b8-91d077ea2e44 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.239544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edde8fb-07ee-4f54-9cc9-8db5a4342183 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.249880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.250952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.251440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.251919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] PATH_INFO: `/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.254576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] RBAC: Authorizing `identity:get_project(project_id=2f9a4c439d9e4fb8b5b20ab81fd61ef3)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.254724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.257344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.261220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 228/448] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/projects/2f9a4c439d9e4fb8b5b20ab81fd61ef3 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:23.276846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.279943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.280630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.281022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.281386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.282217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] RBAC: Adding query filter params (name=member) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:23.282690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.284512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.284782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.295968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 221/449] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:23.302813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.410115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492c614-561b-4930-bb7c-eb8663ae732d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.422630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c35e40-80e1-47e6-b564-25c8074b5c87 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.447987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.448664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.448952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.449225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] PATH_INFO: `/v3/groups/5369664eb8734342a050a55e98855f3b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.450461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] RBAC: Authorizing `identity:get_group(group_id=5369664eb8734342a050a55e98855f3b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.451995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.453753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 229/450] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/groups/5369664eb8734342a050a55e98855f3b => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:23.460129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.462048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.462676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.462964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.463520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.517073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.541660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.550342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.552071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.578407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3c5f-c3c9-4113-a0fd-e99c14c75282 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.617807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.618606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.618967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.619336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.620306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] RBAC: Adding query filter params (group.id=5369664eb8734342a050a55e98855f3b, role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=2f9a4c439d9e4fb8b5b20ab81fd61ef3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:23.620834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.622731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.630731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 230/451] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/role_assignments?group.id=5369664eb8734342a050a55e98855f3b&scope.project.id=2f9a4c439d9e4fb8b5b20ab81fd61ef3&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:23.678041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 222/452] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:23.683886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.808987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc3e67-cd24-4e0d-9267-e6d69ca6c0ef None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:23.853816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:23.854600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:23.854979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:23.855373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] PATH_INFO: `/v3/projects/5f45ed4141604b07a48ead91119799ec` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:23.857225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] RBAC: Authorizing `identity:get_project(project_id=5f45ed4141604b07a48ead91119799ec)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:23.859202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:23.861113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 231/453] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/projects/5f45ed4141604b07a48ead91119799ec => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:23.867382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:23.959703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.986401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5dfb45-684c-427a-8f39-856f18afe4cb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:24.024482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:24.025142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:24.025425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:24.025710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] PATH_INFO: `/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:24.026889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] RBAC: Authorizing `identity:get_group(group_id=b69f89ea68c14d5d99e1241a18fadd5c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:24.028396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f3ec-6c06-4286-aac0-9c61779e7719 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:24.030069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 223/454] 10.222.0.96 () {56 vars in 1180 bytes} [Thu Sep 8 13:41:23 2022] GET /identity/v3/groups/b69f89ea68c14d5d99e1241a18fadd5c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:24.036696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:24.040767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:24.150156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bf7d6-a04d-41b6-acef-0e7d95d5fe68 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:24.187912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:24.188561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:24.188839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:24.189106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:24.189847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] RBAC: Adding query filter params (group.id=b69f89ea68c14d5d99e1241a18fadd5c, role.id=fd19870371784c8facf151d36c77a6b5, scope.project.id=5f45ed4141604b07a48ead91119799ec) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:24.190153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:24.192343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe0645-7efd-4c02-8748-a975adb9160d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:24.198812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 232/455] 10.222.0.96 () {56 vars in 1376 bytes} [Thu Sep 8 13:41:24 2022] GET /identity/v3/role_assignments?group.id=b69f89ea68c14d5d99e1241a18fadd5c&scope.project.id=5f45ed4141604b07a48ead91119799ec&role.id=fd19870371784c8facf151d36c77a6b5 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:28.162452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755138e7-99cc-4629-ac25-26465b875d8d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.163088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755138e7-99cc-4629-ac25-26465b875d8d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.163410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755138e7-99cc-4629-ac25-26465b875d8d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.166735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 224/456] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:28.173181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e1e5-59df-4509-ae83-19c8b7c28b7c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.174536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e1e5-59df-4509-ae83-19c8b7c28b7c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.175283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e1e5-59df-4509-ae83-19c8b7c28b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.216514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a340e1e5-59df-4509-ae83-19c8b7c28b7c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:28.219188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a340e1e5-59df-4509-ae83-19c8b7c28b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:28.387437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:28.388240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738062a-7f03-4e72-a68f-d4d75a512dd3 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.388806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738062a-7f03-4e72-a68f-d4d75a512dd3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.389191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738062a-7f03-4e72-a68f-d4d75a512dd3 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.391100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 225/457] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:28.398217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 233/458] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:28.404732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3c16-b871-4d0b-a1a8-976ef3689b9b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.405157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3c16-b871-4d0b-a1a8-976ef3689b9b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.405544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3c16-b871-4d0b-a1a8-976ef3689b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.437917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-876f3c16-b871-4d0b-a1a8-976ef3689b9b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:28.440035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-876f3c16-b871-4d0b-a1a8-976ef3689b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:28.559928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076184f-3c85-410e-9d82-f9c1aaf870ae None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.560446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076184f-3c85-410e-9d82-f9c1aaf870ae None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.560918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076184f-3c85-410e-9d82-f9c1aaf870ae None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.563728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 234/459] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:28.572152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.573080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.573822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.629649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:28.634312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:28.662623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 226/460] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:28.756719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5c5e-45c3-4ed3-9787-c39d6519a3ee None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.757371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5c5e-45c3-4ed3-9787-c39d6519a3ee None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.757911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa5c5e-45c3-4ed3-9787-c39d6519a3ee None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.759872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 227/461] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:41:28.774448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:28.775090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:28.775567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:28.805522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:28.807251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:28.819904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 235/462] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:28.889580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 228/463] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 08 13:41:28.952361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.158622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9be296-27c2-4421-802b-2b0531931380 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:29.210216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:29.223375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:29.224371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:29.230081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:29.230081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:29.245230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:29.248117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:29.275999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:29.277093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:29.278005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:29.278005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.278005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:29.284315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 236/464] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:29.287904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.290745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:29.291328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.464280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957164cb-3b51-490c-bf0b-bdffa695a73f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:29.476718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720d8b0-cda1-46d2-a8f7-ce10d1563010 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:29.525850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:29.526644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:29.526928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:29.527205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:29.527877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:29.528181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:29.529690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:29.536997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:29.537937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:29.538387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:29.538793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:29.552275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 237/465] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:29.552275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.556381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:29.559173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:29.578680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:29.579721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:29.580720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:29.580720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.580720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:29.580720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 229/466] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:29.581726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.644098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:29.687183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:29.749868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2527-4c26-4416-80ca-da9423fcc81b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:29.753148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a232f07-c67d-47fe-9f38-8d1892c86362 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:29.795780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:29.796462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:29.796742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:29.797013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:29.809357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:29.811481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:29.813806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:29.814880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:29.815298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:29.815711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:29.829372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:29.830871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:29.835140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:29.843039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:29.843940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:29.843940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.843940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:29.843940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 238/467] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:29.843940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:29.853968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:29.854961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:29.855821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:29.855821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:29.855821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:29.856085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 230/468] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:29.857588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.017182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2180b4c-88be-43e1-bc54-d51f85fcecd7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.017517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:30.026123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:30.034015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d5c47-7c27-4dc5-8799-4edca2969a91 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.057074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.057700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.057978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.058246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.058893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:30.059192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.060639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a6dd4-2159-42cd-a917-28d265b90745 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.074031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 231/469] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:30.075129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603af31-ee15-4cd9-8368-343386e6f562 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.075415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603af31-ee15-4cd9-8368-343386e6f562 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.075689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603af31-ee15-4cd9-8368-343386e6f562 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.077125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 232/470] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:30.077883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603af31-ee15-4cd9-8368-343386e6f562 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.105850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.106653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.106999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.107336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.108121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.110022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.215028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603af31-ee15-4cd9-8368-343386e6f562 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.216642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 239/471] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:41:29 2022] POST /identity/v3/users => generated 246 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:30.217966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.297776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.298755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.299269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.299750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.301040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:30.301588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.304360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.330978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 233/472] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:30.330978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.380241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5f28-47ca-45c5-adb4-87bb07ab46d2 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.389288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:30.452951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.454006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.454434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.454972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.455994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:30.456607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.459728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994b720-8e08-458f-b4cd-870b2f3ebea0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.484258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 240/473] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:30.486537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.486992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.487435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.519848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3c1cb-6e95-471f-9861-6a2068d3a43f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.522886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:30.523278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:30.526769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:30.608019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.608861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.609292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.609709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.610784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.612645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.625289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 241/474] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:30.627487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.764034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 234/475] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:41:30 2022] POST /identity/v3/users => generated 248 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:30.766140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:30.804512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b819b-f067-4acd-bbf1-f180bf2b9a3c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:30.932670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:30.933648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:30.934119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:30.934582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:30.935831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:30.937746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:30.959585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:31.012185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:31.047260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d735d1a-3e49-4984-91c3-e49cd1b44622 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:31.107226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:31.108317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:31.108695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:31.109105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:31.109979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:31.112049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:31.146108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 242/476] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:41:30 2022] POST /identity/v3/users => generated 248 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:31.147527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:31.281469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 235/477] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:41:30 2022] POST /identity/v3/users => generated 249 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:31.382002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27e34a0-d57c-486d-914c-2f8fd6a26057 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:31.473461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:31.473461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:31.473773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:31.474178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:31.475436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:31.478288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:31.531027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.sql.core [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:41:31.531027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:41:31.531027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [parameters: {'id': 'a2c9722b68314869bfb9ae48bc52122c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:41:31.531027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93409) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application result.read() Sep 08 13:41:31.563458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:41:31.564407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application yield resource Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise self.value Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application session.commit() Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:41:31.565337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:41:31.569782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:41:31.576116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application result.read() Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:41:31.578229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [parameters: {'id': 'a2c9722b68314869bfb9ae48bc52122c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:31.581000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:41:31.583911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:31.585936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 243/478] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Sep 8 13:41:31 2022] POST /identity/v3/roles => generated 144 bytes in 419 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:31.586081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:31.785293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b66d4-f3d4-48b5-8937-8f95415d7166 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:31.859208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:31.860270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:31.860760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:31.861240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:31.881067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:31.894207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-fd31d072-27a7-479f-9ea1-3c8cde647e66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:31.905003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:31.906315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:41:31.907194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:31.907828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 236/479] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:41:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:31.917957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:32.098471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:32.206312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46e73f-50d3-4f25-9e9c-769a9f769ede None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:32.300827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:32.300827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:32.300827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:32.301371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:32.302527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:32.303009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:32.305649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d6308-8c44-4f97-b058-c8dc7ea7e95a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:32.330423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 244/480] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:34.099275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1255c-442e-428f-8452-b7f69c5a6f34 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:34.100443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1255c-442e-428f-8452-b7f69c5a6f34 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:34.101101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1255c-442e-428f-8452-b7f69c5a6f34 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:34.103327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 237/481] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:34.111314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85311-6bd0-43af-b69c-60b99312e59d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:34.112354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85311-6bd0-43af-b69c-60b99312e59d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:34.112829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d85311-6bd0-43af-b69c-60b99312e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:34.161534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-76d85311-6bd0-43af-b69c-60b99312e59d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:34.163118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-76d85311-6bd0-43af-b69c-60b99312e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:34.315225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 245/482] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:34.942592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a235-05ad-451c-bdd6-91b4fc4aaecb None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:34.943378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a235-05ad-451c-bdd6-91b4fc4aaecb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:34.943893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29a235-05ad-451c-bdd6-91b4fc4aaecb None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:34.946265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 238/483] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:41:34.953449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7669df-06d1-4122-aaf3-aac604045f4b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:34.954088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7669df-06d1-4122-aaf3-aac604045f4b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:34.954583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7669df-06d1-4122-aaf3-aac604045f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:34.983590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1f7669df-06d1-4122-aaf3-aac604045f4b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:34.985241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1f7669df-06d1-4122-aaf3-aac604045f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:35.058823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:35.088488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 246/484] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:35.203051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a235-05ad-451c-bdd6-91b4fc4aaecb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:35.228853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166664b6-19d9-4cf3-905f-71165a87309c None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.229380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166664b6-19d9-4cf3-905f-71165a87309c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.229704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166664b6-19d9-4cf3-905f-71165a87309c None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.232556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 247/485] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:35.241934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98a5-2bc9-4f4e-9a7e-a1cb2f64b3b4 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.242591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98a5-2bc9-4f4e-9a7e-a1cb2f64b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.243061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf98a5-2bc9-4f4e-9a7e-a1cb2f64b3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.281112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-acaf98a5-2bc9-4f4e-9a7e-a1cb2f64b3b4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:35.287655 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-acaf98a5-2bc9-4f4e-9a7e-a1cb2f64b3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:35.428623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29a235-05ad-451c-bdd6-91b4fc4aaecb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:35.452385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 248/486] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:35.454785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a3036-ce1f-4c5f-90d3-f5fc7b3314f7 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.455222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a3036-ce1f-4c5f-90d3-f5fc7b3314f7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.455688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a3036-ce1f-4c5f-90d3-f5fc7b3314f7 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.458384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 249/487] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:35.475005 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:35.476074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.476582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.477208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.478094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.478587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.479062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.495345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:35.506860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:35.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:35.508668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:35.512071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 239/488] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:35.520890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:35.525357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:35.527170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:35.676475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:35.718708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 250/489] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:35.727550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:35.804586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97550858-46d2-4caa-9dd0-a5e64508efa3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:35.836312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:35.914322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:35.915391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:35.915876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:35.916549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:35.917494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:35.918040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:35.919748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:35.940091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 240/490] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:35.947992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:35.966752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c03f0-4d36-4e9c-a5a9-70fc4035fba7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.038503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.039606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.040092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.040712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.063241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:36.070973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:36.072056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.072871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:36.073984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 251/491] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:36.075180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.121922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d5f93-2b6b-48b6-b9e3-a4c9e1770f02 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.160929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:36.186272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.187198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.187602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.188033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.209744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:36.212529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:36.241350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:36.243396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:36.245509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:36.245509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:36.245509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:36.248708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 241/492] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:41:36.250320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.281332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:36.286513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66add-d974-4a18-bad0-aad9baa27f38 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.334376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.335708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.336308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.336857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.353345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:36.359851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:36.361761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.363572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:36.366557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 252/493] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:36.373161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.431797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70a5d4-d913-4dd0-a044-197c41df470c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.476140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.477424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.477968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.478564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.479374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:36.479684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:36.481121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:36.492241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 242/494] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:36.492891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.542838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:36.558701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b095c-054b-441c-8ef1-411f3a4925f8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.605796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.606688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.607158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.607606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.624288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:36.630567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:36.632560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:36.634248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:36.635519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468d9d-04dc-4be5-9e4c-e4a9014c9288 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.636635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 253/495] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:36.638126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.671791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:36.678172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.678800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.679089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.679361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.680024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:36.680623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:36.682135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:36.696536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 243/496] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:36.697598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.785106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a7c37-4fc8-4d1b-b484-20792d171f18 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.844399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:36.847762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.848754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.849208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.849675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.850792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:36.851214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:36.853655 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97b38c-96af-4d6c-8e5a-8819939e2da8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:36.855534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23d093-991a-44cf-8386-58d4478a3c1f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:36.874036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 254/497] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:36.874036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261f89-407b-4efb-9533-7bea143ea300 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.874036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261f89-407b-4efb-9533-7bea143ea300 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.874036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261f89-407b-4efb-9533-7bea143ea300 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.874036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 255/498] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:36.874901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261f89-407b-4efb-9533-7bea143ea300 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.910119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:36.911105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:36.911554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:36.912018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:36.930082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:36.932141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:36.954240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:36.956112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:36.959093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:36.959093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:36.959093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:36.959093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 244/499] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:36.959093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:36.998245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.021026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261f89-407b-4efb-9533-7bea143ea300 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.079073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.080113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.080602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.081056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.082180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:37.082687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.085055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.098113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87df8b-f501-45c6-989f-96495bfd3841 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.099038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 256/500] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:37.100752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.146897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.147827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.148324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.149184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.159854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.161939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2185e817-ead4-4451-a1b4-4ef003501fdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:37.177517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:37.179591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 245/501] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:41:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.181711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.183006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.196233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.202853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:37.211848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:37.259543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076ecc9-9e89-48d4-aabb-bfccc03ba558 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.312235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 246/502] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:37.312235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.312581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.312581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.313228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.313352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.336005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.338865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.344018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:37.370385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:37.372039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:37.373030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:37.373030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:37.373030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:37.373030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 257/503] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:37.376621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.475434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c19ed-8138-4553-9b94-58b0287b324a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.533694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.534318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.534597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.534869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.535559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:37.535858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.537426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.540788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.551885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f15e3a-2f7d-45a5-96cb-a0ceae7cf256 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.558207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 247/504] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:37.558207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.618830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.619845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.620276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.620644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.635804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.637561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:37.663203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:37.664252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:37.665323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:37.665323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:37.665323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:37.665546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 258/505] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:37.667047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.689378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47747e3c-5e73-4a21-8d46-608c2b697183 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.732423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.733153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.733431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.733702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.734482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:37.734787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.736254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.743078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.783377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 248/506] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:37.783377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.831829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504a941-d52f-47c7-8dad-7c0b864e9f63 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.861625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:37.882795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.883504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.883851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.884247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.885055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:37.885448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.887055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.903177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 259/507] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:37.904473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:37.926613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c00937-f091-4060-9a4c-133ec2460836 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:37.969617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:37.970390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:37.970896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:37.971256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:37.980844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:37.982602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:37.996360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:37.997805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 249/508] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:37.999514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.052392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cbe191-deab-4e89-b85d-8d73393cd8f6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.068760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.101955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee406-7696-452a-b981-422c81b34175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.102844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee406-7696-452a-b981-422c81b34175 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.103188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee406-7696-452a-b981-422c81b34175 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.103526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cee406-7696-452a-b981-422c81b34175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.117714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cee406-7696-452a-b981-422c81b34175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.119694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cee406-7696-452a-b981-422c81b34175 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-00cee406-7696-452a-b981-422c81b34175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:38.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:38.145935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:38.145935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:38.145935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:38.145935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 260/509] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:38.146350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee406-7696-452a-b981-422c81b34175 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.154562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69a697-3e03-42c4-9215-cb91299cb261 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.177761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.202752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.203444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.203753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.204058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.206064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:38.206064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.207170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.222765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 250/510] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:38.224233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.300384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cee406-7696-452a-b981-422c81b34175 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.348727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.349732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.350177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.350562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.383471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3fffe-1156-4f33-8c93-a0bdd0c30bd8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.397409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.437266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.438122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.438502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.438982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.448613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.450211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.455386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.457773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:38.466270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:38.468077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 251/511] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:38.470156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.523306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.613149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fc64-e09c-4c89-8ec3-3bf80362f107 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.616392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 261/512] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:38.617722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.654453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.655152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.655363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.655643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.656426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:38.656742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.658231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.690237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 252/513] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:38.692154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.699217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.769842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f6a3-c161-4477-8e34-3e51d15aa5fd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.807892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:38.816755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553392d9-d04e-4c6b-b768-900e5be4260c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:38.824077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.825110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.825503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.825904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.826988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:38.827641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.830525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.855969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 262/514] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:38.855969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.860516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:38.861232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:38.861579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:38.861918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:38.871117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:38.872643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:38.887093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:38.888885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 253/515] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:38.890609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:38.993922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06b5a-d29f-4805-bf77-60c88a4bf607 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.019261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.032707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06203e36-4a2b-43c2-af42-19367b043c42 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.036889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.037612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.038033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.038407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.039291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:39.039727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.041642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.077223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.077921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.078284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.078646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.086163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 263/516] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:39.087590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:39.098240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.100047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:39.117869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:39.119685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:39.127503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:39.127503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:39.127503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:39.127503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 254/517] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:39.127503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:39.130658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.223406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d116d8-0d08-4b4d-b399-20196da2a818 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.263879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fd0e2-7557-4dcd-abf5-ae9a70085a52 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.267991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.268760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.269094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.269535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.313968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.314893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.315345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.315794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.317452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.319939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.341110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.363657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.365516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.420702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 255/518] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:41:39 2022] POST /identity/v3/users => generated 247 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:41:39.422196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:39.518539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 264/519] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:39.520825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:39.537831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.625335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671772b0-5f4b-49ac-9c81-fae47e47615c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.652859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.687592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.687906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062977af-156d-44c5-b8e0-3a63426ec105 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.689315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.691066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.691933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.693678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:39.694542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.698909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.734511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 256/520] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Sep 8 13:41:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:39.736021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:39.756440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.757205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.757674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.758073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.870000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.873823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:39.902169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ac013-760f-4232-9861-b3c418ccaef8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:39.968170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.974318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:39.994000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:39.994966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:39.995389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:39.995847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:39.996814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:39.997256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:39.999272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.002507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 265/521] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:40.003385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.028431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 257/522] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:40.028431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.164880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbadd19-8353-49e1-ae3c-41051e071460 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:40.182520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc0ff-aade-4733-b3e8-c96cc482a399 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:40.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:40.211602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:40.211904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:40.212174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:40.229115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:40.229517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:40.230239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:40.230607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.230794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:40.231088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:40.255414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:40.265225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:40.266863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:40.266863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:40.266863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:40.266863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 266/523] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:40.266863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.299343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:40.309408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:40.329443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:40.331914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.431308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c1764-d4bf-49b9-baf0-0c9d9e12575f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:40.488051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:40.489706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:40.490123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:40.490476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:40.502067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 258/524] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:40.504560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.510722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:40.513512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:40.537887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:40.539662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:40.541662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:40.541662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:40.541662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:40.541662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 267/525] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:40.541662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.664769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:40.673210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:40.694425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502812a8-095a-42f9-a916-8b196ead052f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:40.717597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9430-42f1-46ea-83bf-f4ba30960fb6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:40.742745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:40.745868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:40.745868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:40.745868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:40.746259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:40.746530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:40.749186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.768109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:40.769247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:40.769767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:40.770288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:40.777029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 268/526] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:40.777029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.788695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:40.791402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:40.813014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:40.813961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:40.814838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:40.815259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 259/527] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:40.817060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:40.941196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d91112-41d1-4fea-a63b-05d591e207ef None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.000291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8de6e-d3d0-4ed0-908b-a345604e76e1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.003264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.004824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.006333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.006333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.025087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.028838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.032692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:41.055935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:41.057485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:41.060126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:41.060126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:41.060126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:41.060126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 269/528] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:41.060126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.083645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.084717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.085175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.085574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.086672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:41.087181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.089767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.102272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.116236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 260/529] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:41.116236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.230016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb4af6-43df-4313-a205-b52a179ca61b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.257504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26126601-c452-433d-a62d-c44308d73a1a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.293188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.293846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.294130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.294407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.303215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.304756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.312848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.313919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.314215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.314621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.315498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:41.315946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.318200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:41.318539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:41.328664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 270/530] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:41.330375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.351532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 261/531] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:41.355070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.384026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.448819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b81f7-8bfb-4779-aff7-58f4ddad239f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.453113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.502929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.503573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.503914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.504196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.504910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:41.505215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.506658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.508991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c19ca-e892-40e0-a7fd-41de241bdc60 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.528558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 271/532] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:41.528558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.559392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.560134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.560517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.560909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.571197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.572039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:41.588192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:41.589193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 262/533] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:41.590749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.664668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585ffb7-a8ee-4c49-94e7-c91d39160820 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.683261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.709228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.710265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.710761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.711217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.712525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:41.713082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.716050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.750185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737415a-d650-4c15-a30f-d5a403aa1f5e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.751874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 272/534] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:41.753464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.787251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:41.818553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.819597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.820083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.820605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.821786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:41.822349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.825408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:41.836190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 263/535] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:41.837685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:41.924768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597928a-922b-49b8-9fb9-45e9c3f7f019 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:41.985648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:41.986669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:41.987101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:41.987527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:41.996935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:41.998923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:42.013541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:42.014631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:42.015679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:42.023292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 273/536] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:42.024575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:42.025127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa276e9a-1edb-4e9c-8b71-62c0c6ec7b91 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:42.068075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:42.100506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:42.101202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.101481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.101788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.102515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:42.102823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:42.105543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.124397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 264/537] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:42.125326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:42.183638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ec85-05bd-4bd1-b8f9-f3a60a8be79b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:42.193429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:42.234775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:42.236010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.236467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.236913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.237853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=e34df7c6f30645d292e3595b6c56d134) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:42.238936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:42.241114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.251028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 274/538] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:41:42 2022] GET /identity/v3/role_assignments?user.id=e34df7c6f30645d292e3595b6c56d134&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:42.252247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:42.298358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef575109-576f-4df6-8dea-f501015ab07a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:42.373625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:42.374467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.374867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.375300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.376469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:42.376926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:42.379256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.436803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 265/539] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:42.445831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:42.524553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c40d73-0683-45ea-8f0f-3d7d2f852d4d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:42.550863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:42.582628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d88e-e64a-4b11-89bd-b2492ff32de4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:42.585225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:42.610040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:42.611138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.611645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.612138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.613662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=448c27a70df04007aca38511444d9037) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:42.614337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:42.617049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2127ef15-fbd1-4d34-902d-a2df688c571c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.628260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 275/540] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:41:42 2022] GET /identity/v3/role_assignments?user.id=448c27a70df04007aca38511444d9037&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:42.633271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:42.634368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.634952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.635624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.636686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=12ecb77c3d0b4b06a94562fe8da25ec5) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:42.637229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:42.639029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74805683-fe5d-4914-88c6-ddc915d98435 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:42.647894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 266/541] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:41:42 2022] GET /identity/v3/role_assignments?user.id=12ecb77c3d0b4b06a94562fe8da25ec5&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:42.817537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84d2c-75b6-42e4-9180-c742b562e36a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.818022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84d2c-75b6-42e4-9180-c742b562e36a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.818517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84d2c-75b6-42e4-9180-c742b562e36a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.821694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 276/542] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:42.829846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:42.830515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:42.831035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:42.857958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:42.859766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:42.950100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 267/543] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:43.548886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84d2c-75b6-42e4-9180-c742b562e36a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:43.737616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84d2c-75b6-42e4-9180-c742b562e36a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:43.800938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:43.801925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:43.802482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:43.802945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:43.823302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:43.832266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:43.833241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:43.834187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:43.834793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 277/544] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:43.842962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:43.986781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:43.994814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1f41a-fc9e-4afe-9a2b-0d38158f3708 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:44.040496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:44.041441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.041927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.042371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.043510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:44.044016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:44.045734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:44.056521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 268/545] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:44.065443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:44.137075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:44.307755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c47b-5ea6-4e79-b0b1-69da64214294 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:44.404592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:44.405749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.406208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.406737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.433152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:44.435721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:44.472467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:44.473608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:44.474480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:44.474480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:44.474480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:44.475076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 278/546] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:44.480539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:44.603403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ae582-7db7-4fa1-a043-2ddb01801e2c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:44.681744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:44.682827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.683215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.683598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.684590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:44.685098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:44.687243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:44.717119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 269/547] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:44.723913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:44.855797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:44.889428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fa7b-0365-4c2a-b307-2b1fd131a969 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:44.947701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:44.948417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.948705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.948981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] PATH_INFO: `/v3/users/swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.959199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:44.960759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-0c5e62e6-ea54-4c9e-8f53-b59fcc17a13b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:44.983849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:44.985060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:41:44.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:44.986531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 279/548] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:41:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:44.991556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:45.033110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:45.168394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6bbe4-7b9a-4fc0-941a-e33656993c44 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:45.221638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:45.222889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.223178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.223456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.224244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:45.224555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:45.226018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:45.246313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17687-56c8-44f8-9236-6adf3b7a2c9d None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.246668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17687-56c8-44f8-9236-6adf3b7a2c9d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.246870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17687-56c8-44f8-9236-6adf3b7a2c9d None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.248575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 280/549] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:45.254986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.255411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.255905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.263086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 270/550] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:41:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:45.265951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:45.293943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:45.295937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:45.429708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 281/551] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:45.435693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:45.459773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44dc-2992-44a8-bd5c-0bb6c98e05eb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:45.507835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:45.508497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.508779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.509054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.590059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:45.591579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de039e7-6882-4498-ae23-ce64d85193a4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:45.711420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:45.750123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 271/552] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:45.756245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:45.766284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a2cd-1b95-473a-82c4-554902163b41 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.766613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a2cd-1b95-473a-82c4-554902163b41 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.766850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3a2cd-1b95-473a-82c4-554902163b41 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.768562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 272/553] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:41:45.774654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.775313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.775885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.806284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:45.807810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:45.871863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:45.899270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 273/554] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:41:45.900510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:45.932684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790fe24-48b7-41ff-99b9-d737e18c6bfc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.017525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.018215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.018494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.018806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.043371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:46.045017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:46.047090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8418d451-6546-4b61-b300-a71a5550b336 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.056824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:46.075298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:46.077137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:46.079003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:46.079003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:46.079003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:46.079003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 282/555] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:46.083870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.091256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.092226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.092657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.093329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.106515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:46.111754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:46.113382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:46.114209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:46.120583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 274/556] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:46.122605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.239179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8db6-2e4a-4a23-ac17-6ac9db3396e9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.282704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.283307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.283543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.283765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.285017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:46.285314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:46.286919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:46.297213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 275/557] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:41:46.298343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.308676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba2a4-1217-42eb-b4e2-70308c9bea99 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.336560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:46.338223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:46.367760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337fbece-070b-445f-8efd-27884f220788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.369339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbece-070b-445f-8efd-27884f220788 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.369867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbece-070b-445f-8efd-27884f220788 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.370580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337fbece-070b-445f-8efd-27884f220788 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.371940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbece-070b-445f-8efd-27884f220788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:46.372714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbece-070b-445f-8efd-27884f220788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:46.375600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337fbece-070b-445f-8efd-27884f220788 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:46.398977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 283/558] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:46.401524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10525e-bac6-44e6-a1a2-f5689427eab0 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.402089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10525e-bac6-44e6-a1a2-f5689427eab0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.402460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10525e-bac6-44e6-a1a2-f5689427eab0 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.411893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 284/559] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:46.413612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10525e-bac6-44e6-a1a2-f5689427eab0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.429893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1518d-20d7-4c33-a765-9df833965a17 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.478224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.479171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.479437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.479868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.493419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:46.499279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:46.501123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:46.502778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:46.505402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 276/560] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:46.506793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.574702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10525e-bac6-44e6-a1a2-f5689427eab0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.631166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.631847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.632946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.632946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.635064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:46.646209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:46.647790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:46.655731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dc48d-758f-4d9b-b2fd-e3cd38f1f254 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-5193ae49-ec5a-4da1-802b-037eb7755fba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:46.667639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:46.668795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:46.669692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:46.669692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:46.669692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:46.670727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 285/561] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:46.672438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.672850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.673202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.701905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:46.703243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:46.717544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:46.718821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:46.719232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:46.719775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:46.731897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:46.732607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:46.735142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:46.760093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:46.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:46.763406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 277/562] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:46.764359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.812238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 286/563] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:46.812238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:46.959751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6e05-c49b-41d5-8cfb-3f922036a1fa None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:46.960266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22502-3833-46d4-93d2-fdfb7297d560 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.018821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.019132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.019748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.019887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.020183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.020340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.020648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.020814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.021717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.021868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.022198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.022324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.024522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.024692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b564df9-12d1-40c1-97c0-9961efabbef5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 278/564] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad35d-34df-4b82-97db-0fa872502824 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad35d-34df-4b82-97db-0fa872502824 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bad35d-34df-4b82-97db-0fa872502824 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 279/565] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:47.046225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bad35d-34df-4b82-97db-0fa872502824 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.062190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 287/566] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:47.062190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.069891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.091070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.190670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4a5db-8e2b-4d57-b41d-e2365631d5ba None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.214829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bad35d-34df-4b82-97db-0fa872502824 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.230453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.231099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.231374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.231639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.246598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.249327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.257521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.258251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.258635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.258992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.259783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.260182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.262216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310312e4-9dea-4cb4-8d97-6b61e9e471cd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.276659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 280/567] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:47.277217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:47.279023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:47.280804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:47.280804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:47.280804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:47.281199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.281199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.281199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.285308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 288/568] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:47.286349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.303427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:47.304697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:47.377549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.382787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 281/569] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:47.383680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.407129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.445171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242a4d5-2868-4f4a-836c-b3b67ffc4015 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.496410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.497459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.497876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.498283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] PATH_INFO: `/v3/users/glance` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.512733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.514917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:47.535155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:47.537147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 289/570] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:47.545405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.584162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edacf64-7208-4c6d-ab12-f999c92e447b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.647664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.648828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.649335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.649810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.671805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:47.680045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:47.682014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 282/571] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:47.683826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.725189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d47db3-315a-4ea6-a0cd-93253a4c414b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.754747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.763873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:47.770945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.771650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.771966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.773765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.773765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=a8553aa120db40e6945fbaecf851c363) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.773765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.775059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.781144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 290/572] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/role_assignments?user.id=a8553aa120db40e6945fbaecf851c363&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:47.782089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.826194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e93515-567b-4c34-bd10-27afddb8df8e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.884455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.885095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.885409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.885663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.886329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.886633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.888106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:47.902587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 283/573] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:47.903520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:47.949343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff142d2-caf4-491a-8697-1c9b8f09b642 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:47.994629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:47.995700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:47.996188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:47.997456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:47.997456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:47.997802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:47.999133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.023350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 291/574] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:48.028408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.105908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355f3b-7465-4c6f-9b45-cc247e1032bb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.129075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.133874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.152503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.153155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.153440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.153725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.169947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:48.180273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:48.181282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:48.182292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:48.183675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 284/575] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:48.184344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.214874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57aaf42-b9f0-4d89-8659-afa867403cb6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.287329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.288312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.288804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.289578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.291778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:48.292733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.296828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.311244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 292/576] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:48.312665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.351765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d5a10-7651-4186-a57f-5ee7b470c681 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.417574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.418648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.419134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.419635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.434737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.437542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.441786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81abed-0ce8-4647-b7a0-32247c155ecb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.458896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:48.462299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:48.463325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:48.464830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 285/577] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:48.465749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.491034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.491870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.492167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.492474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.512301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.515031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.521485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:48.545640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:48.546665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:48.547550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:48.547550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:48.547550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:48.547732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 293/578] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:48.549113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.613494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8edd548-8d73-4305-afd9-d5a2273d63e3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.668878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.669858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.670208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.670555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.671303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:48.671683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.673235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.691484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 286/579] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:48.691484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.716661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6b7e8-a4e6-48ce-b7c0-e3330f2ad5c4 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.780131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.781390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.782029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.782508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.804281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.807160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:48.835841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:48.838047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:48.840365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:48.840365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:48.840365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:48.840365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 294/580] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:48.841653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:48.850914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b0834-b0a6-405a-9b78-c7fe7560edbc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:48.853193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.880593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:48.901731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:48.902768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.903231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.903676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.904918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:48.905425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:48.907606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:48.948240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 287/581] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:48.948240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.036706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19b8ea-373c-4934-afdf-9997ef91417d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.087194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.088290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.088829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.089188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.090424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:49.091040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.094157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.121706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 295/582] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:49.121706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.128733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f5276-9a80-40ac-97d6-9c532bf44785 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.190712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.192018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.192659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.193099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.212106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.214689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:49.238031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:49.239689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:49.241290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:49.241290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:49.241290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:49.241290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 288/583] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:49.241290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.266241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.271961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.297419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697425-7321-4010-baa8-2a05166ac5b8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.342839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.343364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.343640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.343909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.344607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:49.344910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.346935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.367787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 296/584] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:49.367787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.414657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b9d20-4c36-4e1f-ba8f-d8c700e9d510 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.459493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.460363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.461004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.474590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.476073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:49.492647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:49.494414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:49.496296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:49.496296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:49.496296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:49.496296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 289/585] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:49.496296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.514150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609a520-cb63-433c-8e4b-83fabc6c57d3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.577672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.578724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.579058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.579447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.591370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.594294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.597639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.602361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:49.615604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:49.622310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 297/586] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:49.624270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.679304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca0bd5-1e60-47a7-9853-2ba0db3a8c16 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.726736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.727508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.727899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.728342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.729160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:49.729763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.731869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.754862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 290/587] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:49.754862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.787955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544a8cc-41f4-4f5b-88fd-d47e63e9d708 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.827500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.828282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.828637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.828909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.842569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.845674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:49.870181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:49.875857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 298/588] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:49.876907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.891465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df5c18c-2cce-4dcc-91b5-624b72e56591 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:49.933426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.947095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:49.947726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.948007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.948310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.949234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:49.949425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:49.950686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:49.957200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.964811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 291/589] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:49.965570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.026987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8317c1-5bde-4005-ab17-f988645c031b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.083877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.085055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.085520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.085971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.086955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:50.087363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.089402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.091763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eb20b-1a9b-4bff-add4-fab6aec0a8ba None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.109242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 299/590] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:50.110707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.150958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.152877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.153290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.153684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.167671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.170209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:50.190122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:50.191164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:50.192088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 292/591] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:50.193457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.235025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24887e-787e-4b64-8963-5eaf78f24a14 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.255219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:50.274295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:50.274944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.275574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.275849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.276127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.276937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:50.277244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.278956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.302371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 300/592] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Sep 8 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:50.303266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.369888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0209-509a-4123-8b79-825cb807c754 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.429175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.430007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.430424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.430859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.440387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.442543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:50.457289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:50.458922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 293/593] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:50.460654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.471739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2519680-4af6-4759-b9b5-3610ac7db9f7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.534777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.535884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.536372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.536815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/e34df7c6f30645d292e3595b6c56d134/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.562671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=e34df7c6f30645d292e3595b6c56d134, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.565482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.664355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d981b8-11a8-42b9-aa3b-2ee427ce6f96 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.664612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 301/594] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:41:50 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/e34df7c6f30645d292e3595b6c56d134/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:50.664612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.664851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:50.733279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:50.736550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.738861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.739704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.740799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.743665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:50.744896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.748530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.800388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 294/595] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:50.802612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:50.891438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e2c2c-eb68-4d5d-81f8-f04557463869 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.952951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.953933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.954402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.954882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.975841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.979969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.004085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52025cbb-dd2f-4944-9d98-c6a63aff7429 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:51.007630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:51.009499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:51.011225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:51.011225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:51.011225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:51.011225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 302/596] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:51.011225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.072899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.073683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.074120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.074582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.075774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:51.076309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.079486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab7156-8457-44e9-974c-f8529944508c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.104250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 295/597] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:51.104250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50b63-4cf6-4b52-88ed-631712c7c34b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.104250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50b63-4cf6-4b52-88ed-631712c7c34b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.104250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd50b63-4cf6-4b52-88ed-631712c7c34b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.104250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 296/598] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:51.105457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50b63-4cf6-4b52-88ed-631712c7c34b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.154339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:51.166933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:51.205714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd1cf5-1bd6-4b26-8974-a4d7a1350fcb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.268368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd50b63-4cf6-4b52-88ed-631712c7c34b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.270315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.271098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.272885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.272885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.295027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.297861 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.315691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.316502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.316882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.317239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.317977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:51.318359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.319859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb5d7b-cfb8-4606-b835-7ca970eeb931 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:51.327913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:51.330131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:51.331864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:51.331864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:51.331864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:51.331864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 303/599] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:51.331864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.348651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 297/600] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:51.348651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.348651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.348651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.365375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:51.366706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:51.477820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 298/601] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:51.479925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.511903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:51.525249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39150ac3-4008-4b4f-8f7a-31d4d2605494 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.588618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:51.601009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.602238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.602790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.603291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.636385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=7a92f1d8d2904002b5f48ff217117039, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.639275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.709378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b70ed3-ffa5-45ba-aa0f-c47adbda3fe6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.720270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 304/602] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:41:51 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:51.720270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.813542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.815265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.815850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.817108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.819231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:51.820301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.821863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.856446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 299/603] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:51.858371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:51.887307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110d82e-11f3-4f9f-8aae-b88be9e3869d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:51.968547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:51.970551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:51.971644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:51.972153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:51.972720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:51.981406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:51.983320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:51.997550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:51.998521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:51.999398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:52.006749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50dc2a-7083-493c-986e-77d3a8d4a53d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.007399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 305/604] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:52.008625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.056316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.056544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.056654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.056904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.066568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:52.078710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:52.084282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:52.091864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 300/605] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:52.093842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.161218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756a1d2-840f-44a2-9249-6eecd1da0360 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.206669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.207684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.207860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.208234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.217636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.219515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:52.235829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:52.238491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:52.241173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:52.244240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 306/606] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:52.245336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.294449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67cdc-f5ad-449d-9d25-354e792dd43b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.330909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:52.336904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.337658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.338348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.338348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.339117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:52.339491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.341248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:52.357013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 301/607] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:52.357973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.443373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:52.449673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565947f-3eb6-45f8-b13d-fea37ff6ad74 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.509555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bb3d5-9bee-4bf2-8ff9-c62d8467a804 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.521380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.526653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.527721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.528964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.535272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:52.536662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.539637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:52.556312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.556875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.557153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.557426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.558142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:52.558446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.559963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:52.561218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 307/608] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:52.562995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.579305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 302/609] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:52.581500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.700545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:52.785337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1fb8-03ec-4b8a-811e-b181cf4834ad None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.809515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe7248-8bdd-489a-a8ff-18170348ce08 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:52.855889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.857633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.858434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.859019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:52.859358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/12ecb77c3d0b4b06a94562fe8da25ec5/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.859952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:52.860599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:52.861084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:52.875202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.877410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:52.896255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:52.898391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:52.900544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:52.900544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:52.900544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:52.900544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 303/610] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:52.901558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:52.902944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=12ecb77c3d0b4b06a94562fe8da25ec5, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:52.907251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:53.042885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968e65-eab4-4971-be50-ac22a3ef34ef None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:53.046342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:53.072811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 308/611] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:41:52 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/12ecb77c3d0b4b06a94562fe8da25ec5/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:53.077400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:53.144013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:53.178672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:53.179365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.179538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.179814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/448c27a70df04007aca38511444d9037/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.228031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=448c27a70df04007aca38511444d9037, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:53.233020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:53.310243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 304/612] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:41:52 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/448c27a70df04007aca38511444d9037/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:53.313636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c750b57-1e2a-4d3b-ad6b-3deb8b4d2e69 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:53.377025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:53.378255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.378871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.379510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.381017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:53.381698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:53.384523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d95c98-6b26-4617-98f9-9fad45750229 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:53.412361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 309/613] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:53.418623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:53.631999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45a4eb-f77d-4052-a4aa-22d838202d3d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:53.695285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:53.695972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.696274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.696548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.710116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:53.711702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:53.729951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c079-6711-404c-bf8c-c7dc36dcaf76 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.730593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c079-6711-404c-bf8c-c7dc36dcaf76 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.731118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594c079-6711-404c-bf8c-c7dc36dcaf76 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:53.733255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:53.734341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:53.735629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 305/614] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:41:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:53.736879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 310/615] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:53.740849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:53.746634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.747341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.747837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.801690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:53.812805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:53.818035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:53.981430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632b5c0-95ed-4aaf-b28c-9331bf383e17 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:54.074557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 311/616] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:54.105675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:54.106701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.107186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.107678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.109084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:54.109635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:54.113046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:54.165725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 306/617] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:41:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:54.171821 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:54.176586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:54.339467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee0ceb-345e-4d28-9539-cec348b4b894 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:54.388454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:54.389185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.389467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.389738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.402947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:54.404538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b03d89bc-6af8-472a-86dc-8c4b95db951e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:54.434845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:54.435895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:54.437567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:54.437567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:54.437567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:54.437567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 312/618] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:54.445882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:54.654224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:54.697142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e947db-4d33-4bc9-a645-cf5951b8543a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.697450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e947db-4d33-4bc9-a645-cf5951b8543a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.697674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e947db-4d33-4bc9-a645-cf5951b8543a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.699328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 313/619] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:54.708962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e947db-4d33-4bc9-a645-cf5951b8543a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:54.720708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c3a06-b5ac-4af0-9260-cb73fa41c76b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:54.762057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:54.762759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.763042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.763315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.763974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:54.764309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:54.765748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff09155-17b2-4320-9d9c-9fbef2abefc6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:54.781686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 307/620] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:54.784626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.785125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.785572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.821727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:54.827698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:54.830892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:54.888597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e947db-4d33-4bc9-a645-cf5951b8543a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:54.935768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:54.936869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.937243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.937575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.950784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:54.957514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:54.959029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:54.960423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:54.964038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 314/621] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:54.965138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:54.991447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 308/622] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:54.993316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.160651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:55.231533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26ab73-9c1e-49a6-b2d8-c0f12f7a10fa None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.241135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46075c99-1d45-49cd-a364-7a4a0b2c9df9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.283675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:55.340711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.343385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.344265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.345043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.360376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:55.363928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.364858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.365243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.365466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:55.365730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.366565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:55.366952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:55.368492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:55.378935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 309/623] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:55.384439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:55.391159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:55.393471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:55.395237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:55.399610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 315/624] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:55.401737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.525411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5645ef8-ca44-4937-84a6-361d58568cb9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.560523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:55.580130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.580866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.581211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.581489 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.599351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:55.605620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:55.607505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:55.609644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:55.612326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 310/625] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:55.615272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.619463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd35e1-10e7-406a-8fc8-6ba510e9e73d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.674785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.676435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.677041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.677670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.692533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:55.694537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:55.718127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:55.719169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:55.720055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:55.720055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:55.720055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:55.727669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 316/626] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:55.729066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.764237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:55.815993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd399d44-5a7f-4d20-8883-4b85cf502dc7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.859102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093c17e-3a5c-4b17-9930-8f410b45ce36 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:55.886515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.887788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.888477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.889107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.890603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:55.891433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:55.894852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:55.904994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:55.905913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:55.907885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:55.907885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:55.907885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:55.908371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:55.910029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:55.924140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 317/627] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:55.925182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:55.926821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 311/628] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:55.930775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.027492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.032434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.050927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dca5d-3c09-439a-9572-b5495566ccd9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.098659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38d3d8-9561-4d27-8052-173e96f4259d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.116171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.117257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.117756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.118254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.119396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:56.119929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.123305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.143914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.144785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.145059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.145330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.147072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 318/629] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:56.149069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.161590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.163112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-72d7a844-f020-4acc-9a34-a00db6d5f046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:56.180616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:56.182466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:56.184044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:56.184044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:56.184044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:56.184044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 312/630] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:56.184044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2c46-d89e-4e74-9fae-1a41db91e7b6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.185889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2c46-d89e-4e74-9fae-1a41db91e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.185889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2c46-d89e-4e74-9fae-1a41db91e7b6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.190971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 313/631] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:56.191984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2c46-d89e-4e74-9fae-1a41db91e7b6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.314812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427ed9e-2037-43d4-9523-885fc9c697ef None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.321491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.330632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2c46-d89e-4e74-9fae-1a41db91e7b6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.368119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.369054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.369525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.369985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/a8553aa120db40e6945fbaecf851c363/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.386788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.388055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.388624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.388731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=a8553aa120db40e6945fbaecf851c363, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.389203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] PATH_INFO: `/v3/users/glance` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.390284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3d61a-36e4-45ef-8ccd-5aead0ac1f90 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.400048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.401555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:56.414838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:56.416452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 314/632] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:41:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:56.419311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.490210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.496746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 319/633] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:41:56 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/a8553aa120db40e6945fbaecf851c363/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:41:56.498969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.499462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.499907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.537531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:56.540745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:56.557467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079f76f-c728-4bc3-85ca-032751f81b8e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.609396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.610487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.611756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.612305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.613242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:56.613814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.615465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.641651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 315/634] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:56.641651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.680967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.702599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 320/635] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:56.703964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:56.878215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b909d-dbff-4c92-b668-d9a971b99e93 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.947802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:56.948775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:56.949278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:56.949740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:56.951086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:56.951577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:56.954866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:56.969783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaea7f8-27f7-4674-86bf-b336e3e42e55 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:56.989651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 316/636] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:41:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:57.013889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.037145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:57.060865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.061960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.062442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.062927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.083053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:57.085829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:57.112254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:57.113266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:41:57.114208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:57.115297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 321/637] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:41:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:57.116460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.203508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:57.266970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511777-0c34-4215-a69f-8dd5d63b4609 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:57.274774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cd8bec-5b99-4443-b85b-84bd1732bd17 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:57.325585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.326354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.326770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.327108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.343342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:57.346673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.348062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.348852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.349604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:57.350115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:57.351847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:57.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:57.356636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 322/638] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:57.357674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.450549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:57.476046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:57.479291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d5052-4149-40bf-a5f4-1fcf05a2961e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:57.549686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab4a9f-5e8a-4db1-aa8c-54896dfd2309 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:57.613008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.613969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.614374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.614864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.615780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:57.616243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:57.618073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:57.629825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:57.647523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 323/639] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:57.651700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.685916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 317/640] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:57.688883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1589d2-74d2-4685-91d6-64b4e636382e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.689459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1589d2-74d2-4685-91d6-64b4e636382e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.690029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1589d2-74d2-4685-91d6-64b4e636382e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.692914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 318/641] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:57.694222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1589d2-74d2-4685-91d6-64b4e636382e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.848828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1589d2-74d2-4685-91d6-64b4e636382e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:57.849156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e509f-cf4b-4270-8409-c9ed5b05f851 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:57.862845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:57.900663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.901865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.902369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.902818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.914544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:57.915644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:57.916151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:57.916682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:57.917883 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:57.918433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:57.921180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:57.937689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 324/642] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:57.939920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:57.989594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:58.036157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.038344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58508173-ec10-4c21-8c5d-e9dce467eeab None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.122157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce43ca9-6d94-4caf-b50e-ee1855a5771a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:58.188803 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:58.189567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 319/643] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:58.189907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.190408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.190926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.192639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.193123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.193684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.216868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:58.217804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.218396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:58.221202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:58.250472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:58.251824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:58.253090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:58.253090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.253090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:58.253090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 325/644] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:58.254378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:58.299151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:58.328234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 320/645] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:58.328234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:58.331673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:58.490804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca454df-a657-4f2e-a55e-b56eb2ae4331 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:58.551291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa35f3c-b5ec-41ca-a632-d8a3d6648e1a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:58.556868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:58.558108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.558709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.560348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.585395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.588845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:58.618633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:58.620543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:58.622505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:58.622505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.622505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:58.622848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:58.622848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.622848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.622848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.626958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 326/646] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:58.628949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:58.651461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.659127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:41:58.686202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:58.688046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:41:58.689932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:41:58.689932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:41:58.689932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:58.689932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 321/647] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:58.690405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:58.781007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:58.809952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:58.830793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901dd7b-2b02-4f73-8668-b034c6344c12 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:58.877630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1eab4-2b15-40f2-ac16-d9dbf9fed50d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:58.887645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:58.889976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.889976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.889976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.890968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:58.891587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.894733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.918219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 327/648] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:58.919763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:58.941952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:58.942983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:58.943473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:58.943969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:58.945220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:58.945747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:58.948356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:58.976257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 322/649] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:58.976257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.124990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74521d-9035-4dd7-afd6-33e459490040 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.165778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa5c17-2815-4fbc-9ea7-5ae7e16661c5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.186722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.195702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.207153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.207153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.207153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.207432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.207511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:59.207511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.207511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.226131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 328/650] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:59.226131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.233740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.234822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.235799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.236309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.256957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:41:59.266618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:59.268777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:59.270518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 323/651] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:59.272060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.401364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0da8-a95a-4d09-a7da-64b59dd5bf75 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.419432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b99fd0-ca9f-4ddf-9ab3-46de0fdfafae None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.451809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.452503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.452782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.453056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.461764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.463298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:41:59.477774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:59.486046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:41:59.487928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:59.488890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.489000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 324/652] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:59.489085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.489164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.489247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.489247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.496763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.499530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-801df3b1-41c8-4c7a-ba2e-383df46dc368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:59.521919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:59.524827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:59.526943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:41:59.527924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.528072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 329/653] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:59.528072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64dc6-934a-49a6-bba4-ad2af45284b5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.528072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64dc6-934a-49a6-bba4-ad2af45284b5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.528072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64dc6-934a-49a6-bba4-ad2af45284b5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.529708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 330/654] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:41:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:59.531102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64dc6-934a-49a6-bba4-ad2af45284b5 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.613701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623bb0-b2d3-46d3-9325-9b42aaa2c8f8 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.633614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.667844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.668757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.669176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.669601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.678764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.680330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:41:59.693084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:41:59.694708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 325/655] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:41:59.695741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.711142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64dc6-934a-49a6-bba4-ad2af45284b5 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.762040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.763066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.763561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.764047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.765313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:59.765868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.768531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.790142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 331/656] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:59.791684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.824164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.835253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4825ba-3b17-424f-bc42-3895f7c7384f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.899111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.900153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.900681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.901173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.902669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:59.903235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.905712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f0b15-53f8-482f-913e-f469cc995e21 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.911604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b672-a3ea-484a-9ba1-0774b161ed88 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:59.928262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.939820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 326/657] 10.222.0.96 () {56 vars in 1139 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:59.945921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.945921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.945921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.951529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:59.952147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.952469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.952741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.953461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:41:59.953778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:59.955784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:59.970666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 332/658] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:41:59.971385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:59.971564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.973220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:00.063290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 327/659] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:00.064517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.108740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aad33-8b49-498d-9c31-d9b2d6b24a8c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.156289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.157952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.159092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.159092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.159790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:00.160388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.162812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.175412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.194474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 333/660] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:00.194474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.201204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b243e-2ca7-4b9e-881f-31a119fecb62 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.245197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.246485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.246858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.247144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.257317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.265267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.267585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:00.292294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:00.294174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:00.295943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:00.295943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:00.295943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:00.299300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 328/661] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:00.301186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.345312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d52e3-d7fe-4295-b9b8-1be38b814226 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.392998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.393635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.393920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.394190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.439759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a9394-a39e-4804-83a0-4dbe53150b56 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.484329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.484884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.485158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.485440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.486197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=e34df7c6f30645d292e3595b6c56d134) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:00.486509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.487979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.490161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.491634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.493004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.504272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 329/662] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/role_assignments?user.id=e34df7c6f30645d292e3595b6c56d134&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:00.504272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.548675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.650790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 334/663] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:00.650790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.668327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cd9b3-b8ee-4fcf-9f7e-1c722c8ada0a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.731419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.732432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.732809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.733375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.734717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:00.735839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.738611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.758172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 330/664] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:00.759500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.839788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42563cd1-7a53-42e0-88ae-1b6892f5f31f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.887680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.889274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.891437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.892005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.892550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.893543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:00.894107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.895808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.900379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.914436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 335/665] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:00.915405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:00.968585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe13781-247c-4e51-816a-04d61f980d67 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.039586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.040683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.041345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.041941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.068123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:01.079184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:01.080919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 331/666] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:01.083627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:01.143046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77bb5c-c4d7-46ee-a145-721ab50fe870 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.216679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.217720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.218189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.218654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.241078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:01.246184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:01.278165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:01.281370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:01.284254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:01.284254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:01.284254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:01.284254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 336/667] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:01.284254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:01.291783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab44a9-3f62-4071-a576-47ea0178c7a1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.339046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:01.359209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.364880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.364880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.364880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.377952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:01.380955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:01.383039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:01.407995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:01.411474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 332/668] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:01.420616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:01.491005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40d95-8630-4b91-8dc5-38d9f1ecc1d1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.571988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.573381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.574066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.574676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.576062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:01.576983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:01.581274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:01.606994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 337/669] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:01.606994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:01.646291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a19e-b306-4e63-8f6f-032dd4a68779 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.729242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.732774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.733949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.734879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.736402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:01.737554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:01.741640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:01.773093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 333/670] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:01.774740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:01.838145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4195e5cc-54cf-4005-a473-ca90d196abf6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:01.858543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:01.881458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:01.910567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:01.911743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:01.912811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:01.912811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:01.914086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:01.914615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:01.918778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:01.961030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 338/671] 10.222.0.96 () {56 vars in 1137 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:01.964736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.000192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582aaa8-7a38-4148-ac92-4360257800cd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.071526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:02.073191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:02.073973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:02.074749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:02.097403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:02.100843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:02.133278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:02.135119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:02.136978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:02.136978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:02.136978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:02.148390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 334/672] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:02.150667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.169269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e381-6f38-4032-8742-5c0f5826a668 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.242893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:02.244263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:02.244741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:02.245195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:02.259570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:02.262422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:02.286778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:02.288525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:02.290279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:02.296373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 339/673] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:02.298380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.352997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:02.363051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:02.374617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548f79-c627-42dd-b6c0-055d4b52b3c4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.449878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:02.451591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:02.452510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:02.453931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:02.504002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556eeecd-b28f-4c50-af22-ee2817b38647 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.572475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:02.573509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:02.574004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:02.574487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:02.575686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:02.576885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:02.579742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:02.608350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 340/674] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:02.608350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.608736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:02.611546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:02.732783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:02.751926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0c64-aacd-4ad3-9f01-5ff4c287b9d3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.785333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:02.804334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 335/675] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:02.805392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.820681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:02.822944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:02.823622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:02.824652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:02.827488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:02.828335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:02.832074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:02.854566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 341/676] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:02.855600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:02.978606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ac2e7-ed9d-4019-82d6-02cc5c866545 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:02.990602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7c790-aba8-4282-a30d-5e0722484b56 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.020088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.020774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.021056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.021327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.035106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.036622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.045283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:03.056169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:03.062421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:03.063344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:03.063344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:03.063344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:03.063344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 342/677] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:03.063344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.074436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.075543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.075892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.076304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.085582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.087438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:03.102101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:03.103144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:03.104080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:03.108505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 336/678] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:03.109799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.180728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.209297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205938c4-e3f9-448f-9c63-ad4b5e17fe5a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.240707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fa500-34a0-4f76-997f-8ec97a9d435d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.254132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.255217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.255690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.256348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.265891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=12ecb77c3d0b4b06a94562fe8da25ec5) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:03.265891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.265891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.267884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 343/679] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/role_assignments?user.id=12ecb77c3d0b4b06a94562fe8da25ec5&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:03.269197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.289166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.290112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.290440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.290717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.291504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:03.291788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.293889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.311734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 337/680] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:03.319417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.356609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.408457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bccb4c-f8f4-4805-89c5-4284c4225505 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.492084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.493331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.494666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.495358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.497645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:03.498448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.501945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.544072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 344/681] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:03.555617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.581920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f57f7-2667-4900-b491-78a0efdfa9b2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.616583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.656087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.656830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.657115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.657388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.670376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.671857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:03.685410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:03.686384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:03.687259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:03.692026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 338/682] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:03.693448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.704584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179c1de-2acb-4438-9fdb-0822d8c1a081 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.729553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.754184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.754184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.754184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.754184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.813296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e07cb2-e24c-4b4e-9c47-fcc3ff2c794e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:03.831859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.833970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.853301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:03.854215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:03.854215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:03.854493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:03.855168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:03.855550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:03.857081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:03.876568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 339/683] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:03.879478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:03.921551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:03.966412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 345/684] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:03.976813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:04.006998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0847eaa-bcf7-421a-92ae-cf7e948296b4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:04.015767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.058516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:04.059164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.059517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.059806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.060614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=448c27a70df04007aca38511444d9037) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:04.060924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:04.062493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9543cd-e633-46a1-8f65-2a0d75681975 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:04.073370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 340/685] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/role_assignments?user.id=448c27a70df04007aca38511444d9037&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:04.092998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee81e5-787c-4d6a-bea7-87d6ac440c65 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.093653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee81e5-787c-4d6a-bea7-87d6ac440c65 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.094206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee81e5-787c-4d6a-bea7-87d6ac440c65 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.096450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 341/686] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:04.103008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3469c1-5441-4da8-8498-4d89bc6c63f9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.103643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3469c1-5441-4da8-8498-4d89bc6c63f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.104123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3469c1-5441-4da8-8498-4d89bc6c63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.126586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9c3469c1-5441-4da8-8498-4d89bc6c63f9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:04.128322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c3469c1-5441-4da8-8498-4d89bc6c63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:04.200787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5bb2-a50c-421a-817e-76723d521a72 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:04.268959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:04.270172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.270692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.271077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.286298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:04.287912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:04.293856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 342/687] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:42:04.295267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3bf84-ef16-425b-9e91-e6332ad73253 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.295585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3bf84-ef16-425b-9e91-e6332ad73253 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.295840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3bf84-ef16-425b-9e91-e6332ad73253 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.305893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 343/688] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:04.317173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.317430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.317748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:04.322159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:04.323952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:04.325814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:04.325814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:04.325814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:04.325814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 346/689] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:04.329986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:04.355747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:04.357214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:04.395736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.457245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 344/690] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:42:04.498519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.575020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67f400-d1ce-4d56-a6c6-677386f5a84c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:04.593954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:04.653957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:04.655053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.655546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.655991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.657289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:04.657834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:04.660549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:04.712265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 347/691] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:04.719106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:04.892870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6a225-9acb-4f86-ad97-4dc0e903b1cb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:04.932706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:04.933357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.933638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.933916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.946070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:04.949968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c841c6-0244-43f9-9cef-d3c440c77a99 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:04.951060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:04.951974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:04.952846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 345/692] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:04.953603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:04.978015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.990026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.996865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:04.997870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.998346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.998824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.009801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.011635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:05.026984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:05.028269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:05.029233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:05.031463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 348/693] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:05.032710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.069679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88714a1-8d63-4408-a7c4-9725e661d0a0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.109810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.110527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.110812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.111087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.123123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.124640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:05.142606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:05.143747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:05.144739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:05.144739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:05.144739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:05.144739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 346/694] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:05.144739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.177807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241ad96-b805-497e-b7ee-440766314f8c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.223915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.224155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.224468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.224746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.225423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:05.225728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.227105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.244300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 349/695] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:05.246760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.260544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:05.304403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aad9f-8c72-4d40-9afd-59d956878150 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.335684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:05.348261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.349282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.349828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.350273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.352397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:05.352397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.353680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.369909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 347/696] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:05.371146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.401274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5777028-7cd9-471a-beb4-b1592b6e1263 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.444268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.444866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.445144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.445416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.446081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:05.446378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.447786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.463999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 350/697] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:05.465028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.513333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e001a01-d9b7-4bb9-b30c-7ee3ce7816d9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.565708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:05.572807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.573670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.573950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.574227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.589210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.591144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:05.612777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:05.614794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:05.617164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:05.617164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:05.617164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:05.619148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 348/698] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:05.620349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.666366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27459cbe-f3e2-4f06-aa51-7b5d4744eb34 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.687204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:05.715211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.716566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.716566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.716834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.717531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=a8553aa120db40e6945fbaecf851c363) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:05.717838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.720176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.732515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 351/699] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/role_assignments?user.id=a8553aa120db40e6945fbaecf851c363&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:05.735648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.845709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345da7d1-6381-4497-8ff0-ec092f23e1d0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.922712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b568f8-9728-47a5-be53-f9cd4a9d6a77 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.933767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.935860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.936792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.937709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.939295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.942374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.965751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.966441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.966777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.967016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.967644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:05.967961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.969974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.987157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 352/700] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:05.992930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:06.044165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:06.079753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 349/701] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:42:05 2022] POST /identity/v3/users => generated 254 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:06.127964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6276b1-e3d4-4e03-a5bc-2653a0023245 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:06.171278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:06.171985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:06.172302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:06.172573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:06.181486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:06.182885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-5dcc5641-dcec-452f-b9ba-5fffbc97ce51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:06.196929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:06.199311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:06.201654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 353/702] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:06.208653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:06.304153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:06.417114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8208cb0-bca3-46f5-a98a-e32bc95dd8ca None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:06.457882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b82b-8063-4a56-b350-4e69cbedfbf8 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:06.458497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b82b-8063-4a56-b350-4e69cbedfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:06.458967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882b82b-8063-4a56-b350-4e69cbedfbf8 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:06.461007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 354/703] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:06.469303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:06.470053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:06.470528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:06.474640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:06.475527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:06.475914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:06.476387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:06.477609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:06.478063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:06.481435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:06.499371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:06.502585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:06.510787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 350/704] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:42:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:06.518288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:06.614170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 355/705] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:42:06.707086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:06.714688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23837fd3-010d-4c29-9696-6b76a09b0506 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:06.801181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:06.802206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:06.802667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:06.803123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:06.903249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:06.904784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.035945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:07.040456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 351/706] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:42:07.043598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.081715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:07.088817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.215643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04637dd-0a45-4af8-af07-98fdbff3d034 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.265169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.266399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.266675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.266945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] PATH_INFO: `/v3/services/network` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.267602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:07.269067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:07.292263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:07.293364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:07.294216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:07.309966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda1c5fa-faa6-4588-a0e3-ea73bf3c9200 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.312943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 352/707] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:07.313939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.407818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:07.432370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.433199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.433578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.433947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.461056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b449c7b-e0a8-4e87-8ee5-53d48339f19f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.461379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:07.463003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-2b59a3e4-ef5f-49c9-8456-997601806d4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:07.480929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:07.482188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:07.483098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:07.483098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:07.483098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:07.483098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 356/708] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:07.483703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2179-b74e-4c2e-bb8c-224b6c4dd9df None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.484543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2179-b74e-4c2e-bb8c-224b6c4dd9df None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.484826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a2179-b74e-4c2e-bb8c-224b6c4dd9df None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.486538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 357/709] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:07.493324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.493324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.493324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.512180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.512996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:07.513449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.513940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.514204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:07.514649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.515558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] RBAC: Adding query filter params (name=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:07.516104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:07.519237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.526823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 353/710] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:07.532609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.631952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 358/711] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:07.631952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.648319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:07.687016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ca87e-9be8-40f0-84d3-23ac38d2214b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.722167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:07.734539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.735632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.736255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.736708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.737729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:07.738251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:07.740328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.756922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 354/712] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:07.765409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.861949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569a099-f625-44fa-a0d2-88b7279b1c44 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.901298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e733-0695-41f0-bf0f-fa25d3c218b3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:07.950281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.951335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.951802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.952290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.961727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:07.964291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:07.980326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:07.981568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:07.982777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:07.986273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 355/713] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:07.993067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:07.994083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:07.995165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:07.995661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:07.997223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:07.997384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] RBAC: Adding query filter params (type=network) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:07.997943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.008866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.024790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 359/714] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:08.054677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:08.121978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da31a-6f2b-4fb5-9ff0-832c5e55ac98 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:08.164759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:08.165771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:08.166240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:08.166688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:08.167766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:08.168298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.170136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.170497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:08.189282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 356/715] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:08.195848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:08.264492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:08.295673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba59d13-6fac-4234-92c3-7d904dd13565 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:08.339467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:08.340451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:08.340735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:08.341011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:08.341470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c138a34-c2eb-4be4-8a66-87836251b700 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:08.341627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.343057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.360952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:08.377483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:08.378544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:08.379420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:08.384818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 360/716] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Sep 8 13:42:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:08.385837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:08.428992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:08.430075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:08.430574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:08.431070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:08.434350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:08.434974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.438034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.450340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 357/717] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:08 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:08.525561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0c73e-4488-40bc-bbca-cec3c4751322 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:08.586790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:08.587413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:08.587699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:08.587974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:08.588671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:08.588980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.590706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5786a-0dfd-4644-84ec-8729ef11acdd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.601130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 361/718] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:08.607212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:08.791003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15427a6-e760-4df6-a519-d293b92db16c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:08.851218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:08.852231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:08.852712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:08.853207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:08.854037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:08.854536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:08.856092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a31d32-044b-42b1-8287-1876bd15f18e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:08.865274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 358/719] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:09.334826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba1df-05e4-4a24-8585-e3123951815c None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.335356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba1df-05e4-4a24-8585-e3123951815c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.335356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbba1df-05e4-4a24-8585-e3123951815c None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.337133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 362/720] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:09.343469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0902b4-2252-4309-9116-0bf1073c8721 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.344065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0902b4-2252-4309-9116-0bf1073c8721 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.344145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0902b4-2252-4309-9116-0bf1073c8721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.364358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cb0902b4-2252-4309-9116-0bf1073c8721 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:09.365599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb0902b4-2252-4309-9116-0bf1073c8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:09.398349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:09.444811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 359/721] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:09.739603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbba1df-05e4-4a24-8585-e3123951815c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:09.742732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:09.886484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbba1df-05e4-4a24-8585-e3123951815c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:09.937015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:09.937691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.937971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.938246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.951430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-6d6f3dd6-ef94-4652-87e8-c82d80b0673f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:09.957026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:09.958059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:09.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 363/722] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:09.961736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc8a9-b926-4d16-a4ab-03a7d401a465 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.962098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc8a9-b926-4d16-a4ab-03a7d401a465 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.962457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486cc8a9-b926-4d16-a4ab-03a7d401a465 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.964066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 360/723] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:09.972238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.972238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.972238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.975550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc8a9-b926-4d16-a4ab-03a7d401a465 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.014634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:10.017315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:10.187816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:10.222192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 364/724] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:10.320539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486cc8a9-b926-4d16-a4ab-03a7d401a465 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:10.394643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:10.396919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:10.397712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:10.398468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:10.399964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:10.400792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:10.403644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:10.422833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 361/725] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:10.432971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.525470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.572741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:10.646034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54346a04-bf81-4727-b061-cc5f1805f882 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:10.719350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:10.720104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:10.720411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:10.720691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:10.737621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58da32-0e2a-4cd5-991d-4a512f4783ac None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:10.745601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:10.747100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:10.778149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:10.781047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:10.784637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:10.784637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:10.784637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:10.785358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 365/726] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:10.789232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.853541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:10.854354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:10.854754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:10.855166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:10.860586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:10.883176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:10.910248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:10.912077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:10.913790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:10.923222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 362/727] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:42:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:10.928991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906b7a0-a2fd-4336-b712-22c10d6fd6f1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:10.929622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.978091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:10.978728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:10.979004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:10.979320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:10.979929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:10.980248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:10.982004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:11.004841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 366/728] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:11.014643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:11.197023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:11.229635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6386b9-c410-4c94-b0ec-57fb375c1605 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:11.265743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46095de7-83f2-4d63-a9f4-ec895ce3371e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:11.284795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:11.309437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:11.310482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.310969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.312723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.315753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:11.316358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:11.319115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:11.335902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 363/729] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:42:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:11.342612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:11.357098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:11.358210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.359312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.360636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.369339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:11.371222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d8665716-4638-4e39-a1ed-613eb8391e49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:11.385944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:11.387005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:11.387946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:11.390874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 367/730] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:11.392551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa075a-59bf-4a42-b749-0f67f2abb377 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.393084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa075a-59bf-4a42-b749-0f67f2abb377 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.393564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa075a-59bf-4a42-b749-0f67f2abb377 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.399561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 368/731] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:11.401616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.402153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.402644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.423892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:11.425692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:11.512569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 369/732] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:11.515236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:11.612432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd60296-fd5b-49f6-b880-ab7ce2467050 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:11.717540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:11.719172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.719683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.720168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.741955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:11.745131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:11.760403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:11.782056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328c8ba-8e5f-4057-abc3-5849981724e3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:11.782356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:11.784273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:11.786048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:11.786048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:11.786048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:11.786048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 364/733] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:11.786048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:11.791947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:11.893599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:11.895144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:11.895922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:11.896785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:11.898420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:11.899234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:11.902092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:11.933219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 370/734] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:42:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:11.934988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:11.987919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec688763-36b6-45ff-be2c-9bf43053362a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:12.042324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:12.043211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.043683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.044178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.045284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:12.047305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:12.048275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0eaae8-2784-4d5a-9a87-d7a3e46962b6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:12.068713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 365/735] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:12.073815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d8c2-6420-4d13-8f5b-29a5b12ad1dd None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.074466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d8c2-6420-4d13-8f5b-29a5b12ad1dd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.075111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d8c2-6420-4d13-8f5b-29a5b12ad1dd None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.079380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 366/736] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:12.081515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612d8c2-6420-4d13-8f5b-29a5b12ad1dd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:12.106572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b0313-9864-474c-9eb7-19752c4149d8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:12.152776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:12.153679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.154018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.154335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.155064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:12.157286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:12.217877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:12.296773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612d8c2-6420-4d13-8f5b-29a5b12ad1dd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:12.324282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 371/737] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:11 2022] POST /identity/v3/services => generated 240 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:12.324282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:12.349092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:12.426574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:12.426574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.426574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.426574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.516822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:12.518530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8241dc3-8fba-42fc-9abc-4ca8d55497e3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:12.524689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3e682-c0e4-41d1-b6c2-e3a45242f782 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:12.591127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:12.591785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.592068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.592381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.593020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:12.602620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:12.604117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-91f98156-6e94-4a2d-adc0-b2b387ae3055 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:12.626380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:12.627488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:12.628479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:12.630282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 372/738] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:12.631686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124555f-5de0-48fe-a76a-7b6e06a38006 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.632326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124555f-5de0-48fe-a76a-7b6e06a38006 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.632612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124555f-5de0-48fe-a76a-7b6e06a38006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.655196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1124555f-5de0-48fe-a76a-7b6e06a38006 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:12.656889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1124555f-5de0-48fe-a76a-7b6e06a38006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:12.669014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 367/739] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:12 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:12.670191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a9166-1aa6-4139-9059-8f217b9dd419 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.670504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a9166-1aa6-4139-9059-8f217b9dd419 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.671443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a9166-1aa6-4139-9059-8f217b9dd419 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.673146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 368/740] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:12.673690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a9166-1aa6-4139-9059-8f217b9dd419 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:12.752009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 373/741] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:12.753356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.753714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.753999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.781504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:12.783021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:12.785270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:12.813471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a9166-1aa6-4139-9059-8f217b9dd419 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:12.855059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:12.856068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:12.856390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:12.856666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:12.857542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:12.857852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:12.859889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:12.887723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 369/742] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:12.889726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:12.897487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 374/743] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:12 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:42:12.897885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:12.946660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.178765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10163-d103-4b02-adfd-796e3c8e3489 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:13.267301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645c9ee-f7b2-4ef0-9d80-0188e08d6e3e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:13.308824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:13.309893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.310386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.310872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.333546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:13.335521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.335902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:13.347995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:13.348990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.349444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.349887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:13.369829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:13.371703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:13.374397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:13.374397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:13.374397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:13.376430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 370/744] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 488 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:13.378230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:13.476651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:13.479085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:13.504045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.575976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b35035-26bc-4821-81ae-2bdcc3058b51 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:13.639925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:13.640962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.641410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.642543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.643662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:13.646308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:13.671702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 375/745] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:12 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 775 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:13.676568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:13.713709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.740940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 371/746] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:13 2022] POST /identity/v3/services => generated 251 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:13.742396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:13.857214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f784a-6884-416a-b8a4-3cd0762848cd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:13.953526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:13.954203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.954478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.954749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.968502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:13.973568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:13.975459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 376/747] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:13.978099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.002339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeeef97-158e-4607-b824-b72aa02709d5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.058482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.070244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.070747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.071051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.071309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.071975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:14.072312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.073738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.095955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 372/748] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:14.097077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.154330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.173165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cb6e2-3739-4d11-b08b-ac1b2c759d1b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.218927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.219512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.219790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.220258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.245859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.249707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.266711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363a446-4199-4489-81ce-90ab999a1440 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:14.292964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:14.294027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:14.294913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:14.294913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:14.294913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:14.296377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 377/749] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:14.297596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.337493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.339400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.340171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.341074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.343307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:14.343842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.347519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.371344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 373/750] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:14.373946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.435669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40596f-3925-4a3e-8181-941801e62f83 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.494944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.496635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.496795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.497168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.498190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.512082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.513960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.518710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:14.529237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:14.530250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:14.531151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:14.538470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 378/751] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:14.539871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.602120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba15b2-a924-46db-a809-9af84a7fb86d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.647513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.648636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.649128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.649674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.650556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:14.651075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.653329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.671903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 374/752] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:14.673305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.755947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53f6eb-83cb-4bc1-b477-f23e2cc9783f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.816286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.817399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.817887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.818366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.833490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.835433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:14.852857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:14.853918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:14.854840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:14.854840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:14.854840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:14.856855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 379/753] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:14.858085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.894802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702118a-afa1-4c81-ae09-99730c6664ea None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.917320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.926241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.949429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.950073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.950357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.950635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.951355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:14.951690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.953361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.974492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 375/754] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:14.974492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.996235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d5f59-36b1-4115-a999-b10ab1af0053 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.036465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.037122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.037407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.037685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.046369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.047858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a8f72bff-6583-4768-813b-e44dcdbe8a45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:15.061160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:15.062629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:15.063590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 380/755] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:15.064157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042a24-b853-4c12-af2c-843a9c9b40e7 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.064742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042a24-b853-4c12-af2c-843a9c9b40e7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.064742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042a24-b853-4c12-af2c-843a9c9b40e7 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.070741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 381/756] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:15.070741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042a24-b853-4c12-af2c-843a9c9b40e7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.161903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4ec4-7978-487e-a490-7ba86a525964 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.211149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.211795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.212073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.212917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.213073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:15.213357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.214995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562e1b-b0bf-4a80-af68-f6e3f94f0ac7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.224535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042a24-b853-4c12-af2c-843a9c9b40e7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.237309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 376/757] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:15.238051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.238051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.238375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.241893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:15.265290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.265914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.266198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.266473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.267217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=a8553aa120db40e6945fbaecf851c363) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:15.267529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.269058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.269960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:15.271968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:15.284432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 382/758] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/role_assignments?user.id=a8553aa120db40e6945fbaecf851c363&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:15.284432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.314222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:15.379358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 377/759] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:15.380371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.541223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca4c08-b4f8-4e14-8b72-bcc649779b67 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.598454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6efefe-7603-4475-9254-d13d9d859a5c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.604104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.604915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.605272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.605620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.606438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:15.606825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.608534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.630557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 383/760] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:15.641730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.657799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.657799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.657799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.657799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.672254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.672254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:15.704634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:15.706523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:15.708441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:15.714574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 378/761] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:15.715999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.731966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:15.763127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:15.867515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c822-4d75-4a6c-bd58-1cf969fa186d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.876249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4bb6-5375-4c8a-bd27-de65447001d3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:15.911600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.912419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.912560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.912928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.913724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:15.914043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.915536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.937801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 379/762] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:15.938901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:15.954046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:15.955796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:15.956712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:15.957617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:15.959543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=340fc101f9434628ba59243d6968163a) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:15.960605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:15.963859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:15.984242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 384/763] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/role_assignments?user.id=340fc101f9434628ba59243d6968163a&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:15.984242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:16.096733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:16.125774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d297d9-59c0-493d-bcbc-d8c4f0182146 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:16.172587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:16.173146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:16.173427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:16.174069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] PATH_INFO: `/v3/services/network` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:16.174700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:16.176244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:16.187648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:16.189607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:16.191278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 380/764] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:16.203286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:16.250678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:16.254677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7942-6858-43f0-a74a-b57b3e782539 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:16.370525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:16.371622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:16.372112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:16.372634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:16.421728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:16.424823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:16.430157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45155542-e70a-498f-a757-6aa16d590099 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:16.459052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:16.460956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:16.462708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:16.462708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:16.462708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:16.462708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 385/765] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:16.470129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:16.525902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:16.527492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:16.528287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:16.529076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:16.531495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] RBAC: Adding query filter params (name=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:16.534486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:16.539362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:16.558319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 381/766] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:16.570168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:16.578855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:16.818673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5aa5e-9556-43a5-8e54-e39de6b2510c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:16.899808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631660a-0570-4632-af2b-609e550966c6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:16.929169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:16.930946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:16.931549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:16.932257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:16.933704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:16.934493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:16.941869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:16.986597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 386/767] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 517 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:16.992053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.017270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.019213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.019951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.020703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.022062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] RBAC: Adding query filter params (type=network) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:17.022807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.025783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.034197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.037123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 382/768] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:17.043529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.262673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.286006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a3c95-b042-421d-abb3-7691f77c3760 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:17.325766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6ea76-a62b-491b-9e55-f8728ac9638c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:17.340500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.341360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.341763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.342689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.350694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.352386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a5c98b5e-d690-4b34-a9cc-52b7de520cd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:17.365500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:17.367533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:17.370050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:17.376249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 387/769] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:17.376249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54130-6884-48c6-860e-f3fd162685f2 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.376249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54130-6884-48c6-860e-f3fd162685f2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.376249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac54130-6884-48c6-860e-f3fd162685f2 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.377172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.377172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.377575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.377724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 388/770] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:17.378023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.378462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac54130-6884-48c6-860e-f3fd162685f2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.378942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] RBAC: Adding query filter params (interface=public, service_id=d971a5aa5f884f36ae103bac88de3e31, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:17.379432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.381002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e385f9-6de0-4748-8e57-3d5fa97362e6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.393572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 383/771] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:17 2022] GET /identity/v3/endpoints?service_id=d971a5aa5f884f36ae103bac88de3e31&interface=public®ion_id=RegionOne => generated 194 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:17.395406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.395701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.395980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.422476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:17.424435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:17.482358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.507778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 384/772] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:17.508924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.521173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac54130-6884-48c6-860e-f3fd162685f2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:17.561469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.562477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.563016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.563496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.564457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:17.564984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.566793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.583475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 389/773] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:17.583678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.592273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.648892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec1d9-406e-4fc6-a211-c4953ca16748 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:17.697315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.697973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.698303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.698575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.699207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.700664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.718343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 385/774] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:17 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:17.800779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd3017-77a8-40d5-9238-da36455511a1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:17.876105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.882198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:17.882896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.883191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.883444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.890471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=7a92f1d8d2904002b5f48ff217117039, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:17.892066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02adf8b7-d2f6-4295-82c5-968461b94b32 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:17.918709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:17.994804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 390/775] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:42:17 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:42:18.043147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e1ac-70fe-4281-a9b2-48e844bd40e6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.043422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e1ac-70fe-4281-a9b2-48e844bd40e6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.043690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5e1ac-70fe-4281-a9b2-48e844bd40e6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.045578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 391/776] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:18.052692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.052942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.053135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.070921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730e221-ff0e-4c58-b85c-79224d87b158 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:18.074512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:18.075850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:18.121145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:18.146105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:18.146778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.147060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.147334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.148015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:18.149506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:18.168693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:18.169986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:18.170974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:18.171828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 386/777] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Sep 8 13:42:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:18.178609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.210867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 392/778] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:18.337469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc6df55-6c4e-4ea7-821b-b48d15bb5f8a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:18.385044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:18.385677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.385956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.386229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.386882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:18.387188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:18.388647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:18.395262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 387/779] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:18.409458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.550322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e49b25-7b64-4b4d-b33b-79d8af56fdfb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:18.605094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:18.628264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:18.628900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.629187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.629493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.630116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:18.630420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:18.631840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:18.642105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 393/780] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:18.652048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.748956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.755557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:18.850054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b750b4-9fdd-46d6-bc04-6b5b468c0204 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:18.901156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:18.901686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.901968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.902244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.902973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] RBAC: Adding query filter params (interface=public, service_id=8b2e3b687e3f42289e5187654ca93fdb, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:18.903285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:18.904832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:18.911472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 388/781] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/endpoints?service_id=8b2e3b687e3f42289e5187654ca93fdb&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:18.922103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.979180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a9d3f-d386-4e07-8e8e-c4aaa86097cc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:19.043301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:19.044461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.044461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.044984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.058438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:19.063909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:19.067373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:19.069552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 394/782] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:19.076259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:19.133188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:19.164238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e90dd-1a7c-43bd-9863-32d124d7f8ed None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:19.198108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb55ee-a78e-4932-9904-d7952071cda5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:19.221866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:19.243125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:19.244132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.244704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.245193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.246136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:19.246664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:19.248364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:19.259091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 395/783] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:19.265348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:19.290964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:19.292056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.292620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.293117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.294030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:19.305062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5710f-b4c3-4ab7-b6ab-030131bacf5d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:19.317378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 389/784] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/services => generated 772 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:19.467504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6338c0-fee1-446a-8479-9861cedb1a79 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:19.496697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:19.553685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f66d-b765-4a35-8be6-88ff84b32677 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.553952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f66d-b765-4a35-8be6-88ff84b32677 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.554238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267f66d-b765-4a35-8be6-88ff84b32677 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.556070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 390/785] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:19.566233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:19.567055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.567309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.567776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.567962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.568242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.568692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.595441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:19.597292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:19.603914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:19.606772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:19.650266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:19.651301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:19.652332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:19.652332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:19.652332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:19.655240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 396/786] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:19.661447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:19.684622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 391/787] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:19.805686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272266c0-d2e1-490f-a153-f8199643e4a6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:19.846255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:19.847239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:19.847716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:19.848245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:19.849175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:19.849699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:19.851305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:19.866135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 397/788] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:19.872242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:19.997371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a78c076-5291-4e8d-ba76-2f2abd22cc1f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.015408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.047904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.048602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.048879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.049158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.058207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.059669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:20.078610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:20.079666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:20.080690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 392/789] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:20.086494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.113107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.127870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.255123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719e0f7-d4b4-43b5-8ab7-87226e6b9cdd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.321183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d526c5-d573-484c-9a71-0cd954114ba7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.330247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.331236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.331714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.332237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.333227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:20.333749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.335552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.358491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 398/790] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:20.367700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.387555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.388534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.388971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.389425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.416868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:20.432238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:20.433472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:20.434632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:20.438537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 393/791] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:20.446858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.480787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.509346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3c517-b83c-439e-a11c-e99e2d9ed339 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.551355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.552187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.552543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.552913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.565685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.567378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:20.585182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:20.587117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:20.589251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:20.589251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:20.589251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:20.589599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.589733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 399/792] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:20.594400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.707351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9b6f9-c9b9-4994-9dbf-fb586cadc219 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.761428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.762085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.762364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.762638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.763338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:20.763675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.765586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494539c9-4517-4960-ada4-cb3e962e5332 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.780338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 394/793] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:20.783054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c1a-6a17-4610-8d55-3e9f19fedeb6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.783411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c1a-6a17-4610-8d55-3e9f19fedeb6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.783696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c1a-6a17-4610-8d55-3e9f19fedeb6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.785416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 395/794] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:20.786275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4c1a-6a17-4610-8d55-3e9f19fedeb6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.799521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7d070-0222-4d3d-924d-feff13f0cdde None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.833384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.850047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.850047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.850047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.850047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.850511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:20.850511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.850511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e384e8-d3a0-4cef-9e76-f0d67b676301 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.867234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 400/795] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:20.869096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.869628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.870096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.895693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:20.899896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:20.908915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.918550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4c1a-6a17-4610-8d55-3e9f19fedeb6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:20.962196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:20.962957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:20.963326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:20.963675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:20.977579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:20.979363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:20.987001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 401/796] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:20.988252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:20.998224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:20.999281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:21.000194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:21.000194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:21.000194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:21.000194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 396/797] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:21.011933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.143080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d692f-9947-4ddb-9ea7-e5680b7c899f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:21.168426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:21.185687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:21.186727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.187216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.187745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.198234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:21.203730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:21.220121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:21.221101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:21.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:21.224569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 402/798] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:21.230830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.332655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a593e-fc40-43f0-9aad-aae2feead839 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:21.412763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:21.413741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.414245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.418050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.419400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:21.420550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:21.425903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:21.465237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 397/799] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:21.472787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.499822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:21.522707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104fa7f-c866-41e8-996d-4201ad2e1e84 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:21.615948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:21.616627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.616974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.617253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.618350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:21.618666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:21.620822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:21.640444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 403/800] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:21.642234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.670771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a280084-0bf9-4352-8b20-0e2143824101 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:21.710281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:21.733618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:21.735027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.735740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.736497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.753570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:21.757948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:21.785615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:21.787806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:21.789950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:21.791059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8ac31-8f24-4790-a5ec-3db8681c081f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:21.794032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 398/801] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:21.796067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.844924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:21.845565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.845841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.846106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] PATH_INFO: `/v3/services/network` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.846696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:21.848139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:21.867205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:21.868330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:21.869675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 404/802] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:21 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:21.870657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:21.916452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.057387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c75b1-fd2c-4a0e-83ba-e9a0c683eb86 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.062052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.082675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb82aa-2b21-462d-abba-039b2cc21f10 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.101068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260db700-a18f-4678-8057-15260234c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.101721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db700-a18f-4678-8057-15260234c68b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.101998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db700-a18f-4678-8057-15260234c68b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.102307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db700-a18f-4678-8057-15260234c68b None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.103065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db700-a18f-4678-8057-15260234c68b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:22.103410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db700-a18f-4678-8057-15260234c68b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:22.104918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db700-a18f-4678-8057-15260234c68b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:22.129865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.130263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 405/803] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:22.131179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.131911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.132241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bf0f-f4b5-4b29-8de2-ef71962df3db None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.132577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/a8553aa120db40e6945fbaecf851c363/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.132895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bf0f-f4b5-4b29-8de2-ef71962df3db None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.133342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bf0f-f4b5-4b29-8de2-ef71962df3db None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.135242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 406/804] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:22.136365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bf0f-f4b5-4b29-8de2-ef71962df3db None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.138072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=a8553aa120db40e6945fbaecf851c363, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:22.141595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:22.231883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 399/805] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:42:21 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/a8553aa120db40e6945fbaecf851c363/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:42:22.238751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.282190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bf0f-f4b5-4b29-8de2-ef71962df3db None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.331926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.333049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.333323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.333592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.334263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] RBAC: Adding query filter params (name=network) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:22.334565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:22.335994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b1aa9-c9a2-4ece-a007-ae82adb0a780 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:22.347492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 407/806] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:22.349185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.349534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.349845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.371786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:22.373786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:22.404753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.467389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbfcbf-f498-4a19-9ac2-f7b0abf5e352 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.502836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.512727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.513483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.513806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.514095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.518987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 408/807] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:22.520908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.542919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:22.546660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:22.589916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:22.591892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:22.593783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:22.593783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:22.593783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:22.597485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 400/808] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:22.603682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.696238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ceb7-3c3d-4e20-aa32-0bc20358a14a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.732497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.733132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.733406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.733680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.734325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] RBAC: Adding query filter params (type=network) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:22.734623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:22.737261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:22.742765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 409/809] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:22.753690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.835296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.923443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7dc46-e141-4d07-8f10-d6c8e4689316 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.001514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.003592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.004622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.004929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.005619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:23.006045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.007375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.013894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a9e38-d3af-4945-8110-ae2d1c16a941 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.028345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 401/810] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:23.029924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.086088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.087668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.088472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.089548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.091060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.094569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.120075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:23.151464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9527d-0c52-4ab4-a9ce-21b1186a5aa9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.203322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.204750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.205566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.207495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.224449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:23.224747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 410/811] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:22 2022] POST /identity/v3/endpoints => generated 337 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:42:23.226206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-917c22df-4856-42ca-b590-015c21bcae68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:23.229791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:23.231767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 402/812] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:23.245401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929982-49e8-493f-ab33-9edf8118b744 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.246259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929982-49e8-493f-ab33-9edf8118b744 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.246259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929982-49e8-493f-ab33-9edf8118b744 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.246259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 403/813] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:23.247573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929982-49e8-493f-ab33-9edf8118b744 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.413062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:23.428447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:23.443001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929982-49e8-493f-ab33-9edf8118b744 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.463570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa804b-3a3b-47c2-a5a1-7c00381fe50d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.489631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.490336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.490516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.491265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.492170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:23.492523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.495031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dee48-2e0f-4b6b-8265-e32acdafa33d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.506815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 404/814] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:23.508673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.508965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.509238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.532045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:23.533400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:23.534721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.536178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.536964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.537789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.553641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.556597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:23.582104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:23.583286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:23.584182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 411/815] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:23.585891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.651952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 405/816] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:23.653452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.742440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cddbd-2bc8-4ebf-af27-2ea5152d7ff1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.784598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.785360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.785701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.786093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.790394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:23.800390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:23.802378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.804834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.819703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50394a8-3324-4b54-9bbe-20ce1862777f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:23.821294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:23.822232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:23.823137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:23.823137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:23.823137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:23.823137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 412/817] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:23.832529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.897662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:23.899145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:23.899145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:23.899588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:23.900947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:23.901481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.904963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.929396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 406/818] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:23.944236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:23.990118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a07b5bc-29b9-4212-b181-5b610d760c80 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.051876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.052777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.053057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.053325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.053981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:24.054966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.056430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.076340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 413/819] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:24.076340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.130872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d397637-4697-44bb-9363-813d5fbdceba None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.137776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.174169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.174867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.175149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.175427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/340fc101f9434628ba59243d6968163a/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.194119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=340fc101f9434628ba59243d6968163a, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.195891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.201045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.208494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc170e-4bb3-4df8-bf19-a2a90a4b4eb9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.246381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.247050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.247324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.248172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.248796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.250174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:24.260049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:24.265838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:24.267704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 414/820] 10.222.0.96 () {56 vars in 1129 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:24.268721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.315250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 407/821] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:42:23 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/340fc101f9434628ba59243d6968163a/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:42:24.315250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.404065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f0b31-6db1-4713-8582-15f5049f0b8e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.422000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.448540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba17a9d-54ec-4c70-a0f8-c6c3bb8850d6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.451394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.452521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.453096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.453611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.495370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.496085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.496357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.496750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.498090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:24.498448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.499964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.506574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 408/822] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:24.516253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.605210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.606775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:24.624238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:24.626131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:42:24.627959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:24.629172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 415/823] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:24.631992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.671557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.753042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b3b30-ad69-4476-8c41-4379a7564ee0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.786157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925d488-e9b0-4d98-b014-e91584a4e556 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:24.824242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.825374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.826007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.826599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.827821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:24.828541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.831285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.840480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:24.841028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 409/824] 10.222.0.96 () {56 vars in 1124 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:24.841233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:24.841390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:24.841678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:24.842432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:24.842737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:24.852254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:24.852516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.868374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 416/825] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:24.875060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:24.919341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:25.025563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552f03f-3b36-4894-898b-c666679bcac7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:25.061175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829f63c-7bf4-4161-b71c-37319a57c981 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:25.107670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:25.109660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:25.110488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:25.111755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:25.112967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:25.135041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:25.137412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:25.138784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:25.139576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:25.141979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:25.145499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f77fd-e71f-448b-8720-d27304957326 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:25.266101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 410/826] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:25.272366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:25.275018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:25.290176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a83f1-a06e-452b-8554-cc34cf2c3146 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:25.290598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a83f1-a06e-452b-8554-cc34cf2c3146 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:25.290792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a83f1-a06e-452b-8554-cc34cf2c3146 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:25.297037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 411/827] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:25.299099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:25.299383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:25.299653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:25.322054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:25.323309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:25.350982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:25.432913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 412/828] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:25.514868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 417/829] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:24 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:42:25.524943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:25.667887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c791-e529-4e7c-83aa-138e4b92f908 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:25.683195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:25.726808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128d59-c787-4846-be06-750d255e879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:25.727907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128d59-c787-4846-be06-750d255e879c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:25.728465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128d59-c787-4846-be06-750d255e879c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:25.728973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26128d59-c787-4846-be06-750d255e879c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:25.743250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128d59-c787-4846-be06-750d255e879c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:25.745069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26128d59-c787-4846-be06-750d255e879c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-26128d59-c787-4846-be06-750d255e879c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:25.764237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:25.765256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:25.766144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:25.766144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:25.766144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:25.768541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 413/830] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:25.777173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:25.870708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128d59-c787-4846-be06-750d255e879c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:25.979746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477b281-3585-4f7f-95c4-cec58ff45fbc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.007529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26128d59-c787-4846-be06-750d255e879c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.029113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.038282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.039694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.040152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.045843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.045843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:26.045843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:26.045843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:26.063615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 418/831] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:26.073994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.089982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.090635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.091417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.092813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.111024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:26.117107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:26.118122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:26.119408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 414/832] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:26.128736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.170329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.292817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96998fd-b480-41ad-a74f-dad6d5e6f6f1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.340190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630ef29-74f9-4460-be86-a0e6c255c01c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.362173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.363290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.363798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.364330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.376491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:26.379119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:26.401043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:26.403234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:26.405365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:26.408529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 419/833] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:26.409532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.412642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.413558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.414001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.414457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.415714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:26.416417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:26.418974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:26.435906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 415/834] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:26.443976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.519312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.630158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.638737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8753-0afe-4102-a456-076d1adf41af None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.672691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6ae0d-05d4-4a74-8d92-66f56a853085 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.716884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.718466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.719289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.720065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.721763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:26.722645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:26.725774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:26.741266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:26.742416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.742911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.743468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.760750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 420/835] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:26.764096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.766361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:26.769559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:26.799593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:26.801783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:26.803616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:26.803616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:26.803616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:26.808127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 416/836] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:26.812178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:26.975742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be8d62-3ce3-4e31-be04-12e251a8aa90 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:26.998912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.025030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b306b2a-a784-4938-87c3-ae2c1582bb95 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:27.047957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:27.048740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.049080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.049418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.050236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:27.050611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:27.052190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:27.063038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 421/837] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:27.092354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.102787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:27.103845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.104361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.106975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.106975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:27.106975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:27.109683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:27.137529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 417/838] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:27.147463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:27.279820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba588e-e0f6-4f90-8f1b-9a19aa593f02 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:27.322729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:27.323434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.323768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.324043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.333114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:27.334744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-5addd0b5-18af-4d55-8911-7412ca21e0c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:27.351371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:27.354706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:27.357574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 422/839] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:42:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:27.363793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:27.555334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24900dc-d191-4713-a2ab-f6aa071e565d None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.556078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24900dc-d191-4713-a2ab-f6aa071e565d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.556078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24900dc-d191-4713-a2ab-f6aa071e565d None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.558998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 423/840] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:27.568752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.568752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.569058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.593333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:27.594626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:27.595633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc263-5a9f-4f3e-bfb3-f4f2eb32b411 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:27.647642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:27.648663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.648663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.648912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.649633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:27.649941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:27.651423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:27.660001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.700810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 418/841] 10.222.0.96 () {56 vars in 1135 bytes} [Thu Sep 8 13:42:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:27.704911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:27.772249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 424/842] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:27.825546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.929184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039949a4-c309-42df-9ef5-3799b3ff3c19 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.002962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.004004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.004526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.005026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.049718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.134549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:28.138243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30f2a2-cd52-4059-a77c-a3b4874fe25e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:28.200792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538812bc-3135-46d0-8842-1f9c12c1c1ad None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.201828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:28.248901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.249568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.249850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.250127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.269806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:28.277427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 419/843] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:42:28.277427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a92a-7974-4796-be48-7bee26da5d6f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.277427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a92a-7974-4796-be48-7bee26da5d6f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.277427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7a92a-7974-4796-be48-7bee26da5d6f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.277427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 420/844] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:28.279031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a92a-7974-4796-be48-7bee26da5d6f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-6b267d87-a55a-4e8e-9f1c-71ca990418f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:28.280259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:28.281371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:42:28.282394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:28.283099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 425/845] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:28.284999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.285483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.285972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.315575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:28.317464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:28.347033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:28.428238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 426/846] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:28.429561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.475964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7a92a-7974-4796-be48-7bee26da5d6f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.541097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.542519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.543260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.544588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.562890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:28.564959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:28.611712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28f9f8-ee60-4e80-be06-fa848b0610c7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:28.613823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:28.614753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:28.615713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:28.615713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:28.615713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:28.616335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 421/847] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:28.625937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.630901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:28.666729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.667722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.668232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.668738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.670270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:28.670734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:28.672403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:28.683345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 427/848] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:28.696533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.717027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:28.803329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57088f-79b8-47ee-bec8-013d1cee56c2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.842867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.843782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.843949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.844117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.844948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:28.845316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:28.846882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:28.853649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669bc450-036a-4fe0-a70b-a5ed87c70e2a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:28.868362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 422/849] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:28.871047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.906098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:28.906814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:28.907147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:28.907487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:28.920147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:28.921720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:28.942851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:28.944725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:28.946444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:28.946444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:28.946444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:28.948579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 428/850] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:28.950527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:28.995667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.055629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.057138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db27a0e-e47a-44e7-8401-e0576b293b99 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.103466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.104361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.104525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd7fbe3-779b-4dea-812f-3d2ff9c3db64 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.104851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.105234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.114546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.116034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:29.128580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:29.130352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:29.132073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:29.134765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 423/851] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:29.135618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.156456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.157343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.157801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.158232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.159209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.161290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:29.173651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:29.175549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:29.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 429/852] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:29.181302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.283002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6dd31-3324-4103-9d0a-d8635c67dd05 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.314273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.317172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc79c0d-dac2-4c80-949a-fb2149391a42 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.332395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.333654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.334029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.334905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.335912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:29.336383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.338446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.357296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.365987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 424/853] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:29.365987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.371088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.371088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.371088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.371342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.372507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:29.372987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.375627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.394862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 430/854] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:29.396089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.535190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bde15f-705e-4f40-8269-12c175a668de None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.540229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bc0e6-7986-4bbc-ae7b-2b29bc34096f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.585242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.586071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.586349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.586624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.587263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:29.587562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.589332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.595823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 425/855] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:29.596723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.598245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.599802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.600394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.600792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.611690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.613722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:29.630260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:29.632641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 431/856] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:29.635073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.677966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.711073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:29.762109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e43bd-941b-4544-b47a-f66953469ce1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.793922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9fde8-14b7-427d-bbf6-88cdb0f717f5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:29.822213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.823160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.823609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.824057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.825804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=a8553aa120db40e6945fbaecf851c363) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:29.826308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.828951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.839496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 426/857] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/role_assignments?user.id=a8553aa120db40e6945fbaecf851c363&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:29.840709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:29.850477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:29.851113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.851386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.851706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.852420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:29.852732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:29.854182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6716141-ff99-4dfe-9afb-d31c5fd3968d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:29.860034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 432/858] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:29.866665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5ab0-bbde-4a20-9a05-892a9a5e8142 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.867300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5ab0-bbde-4a20-9a05-892a9a5e8142 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.867937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a5ab0-bbde-4a20-9a05-892a9a5e8142 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.871195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 433/859] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:29.879015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:29.879529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:29.880038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:29.906832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:29.909044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:30.040248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 434/860] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:30.051787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8385f58-8f2a-40a4-a922-24ec0e14d10d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:30.066687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:30.098333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:30.098980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:30.099265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:30.099629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:30.100503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:30.100821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:30.102410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:30.125929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 427/861] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:30.132231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:30.199768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:30.273600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a377a-f89e-4706-bdee-279b000a09e9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:30.318991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:30.319585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:30.319870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:30.320145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:30.419696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:30.423010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:30.505919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:30.515354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:30.625425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 435/862] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:42:30.633651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:30.638833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbe1e4-8983-4717-b85e-a0c0e3377d26 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:30.688567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:30.689556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:30.690053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:30.690525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:30.691335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:30.692983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:30.703847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:30.704961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:30.705887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:30.708829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 428/863] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:30.720290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:30.758826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:30.823306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d7ed-fc4b-4e59-9e7f-00e0cbdf402f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:30.844516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf1d2e-19ac-4e9d-aed8-a682ca666b89 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:30.890776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:30.891723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:30.892171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:30.892617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:30.893440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:30.893903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:30.894999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:30.895793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:30.896389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:30.896965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:30.897516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:30.907626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 429/864] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:30.908935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:30.918807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:30.921897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:30.935266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:30.951561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:30.952900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:30.954027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:30.954027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:30.954027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:30.954210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 436/865] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:30.960879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:31.035333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:31.043449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37051a-6039-4480-8c42-e722af2d1b43 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:31.088287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:31.089421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:31.089898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:31.090487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:31.091333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:31.091867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:31.093598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:31.104809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 430/866] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:31.166360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0ea37-1ab9-4486-a518-6f321b79915d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:31.240153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:31.241259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:31.241764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:31.242267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:31.243506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:31.244076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:31.247485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:31.272638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 437/867] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:31.278665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:31.405735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee29bb-0a85-4330-902c-93b4a58d843c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:31.470289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:31.471342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:31.471821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:31.472334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:31.486538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:31.489374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:31.513009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:31.513990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:31.514927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:31.520588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 431/868] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:31.525794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:31.643151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:31.716256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6abf9-a4de-4aa9-82e3-9c29857adc49 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:31.763771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:31.764842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:31.765322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:31.765829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:31.766760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:31.767277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:31.768999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b07abf-01a3-4e0c-be9e-9caf09ca000e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:31.785246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 438/869] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:31.795870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:31.842637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:31.979427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d6fb-4146-4c90-94f3-da41a7682ddd None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:32.022100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:32.023219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.023717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.024244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.025246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=340fc101f9434628ba59243d6968163a) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:32.025949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:32.028535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32eb36d-6e16-4cd6-af08-dbe3cf560061 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:32.036402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 432/870] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:31 2022] GET /identity/v3/role_assignments?user.id=340fc101f9434628ba59243d6968163a&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:32.203308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc605-dc1e-4d6d-946d-0a8fecb6b64c None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.203785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc605-dc1e-4d6d-946d-0a8fecb6b64c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.204280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dc605-dc1e-4d6d-946d-0a8fecb6b64c None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.206596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 439/871] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:32.214573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab32d-5e71-4eda-ac95-f9c56e03f978 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.214961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab32d-5e71-4eda-ac95-f9c56e03f978 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.215177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cab32d-5e71-4eda-ac95-f9c56e03f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.236480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-13cab32d-5e71-4eda-ac95-f9c56e03f978 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:32.237863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-13cab32d-5e71-4eda-ac95-f9c56e03f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:32.330832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 433/872] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:32.621419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc605-dc1e-4d6d-946d-0a8fecb6b64c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:32.752820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dc605-dc1e-4d6d-946d-0a8fecb6b64c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:32.773676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:32.799469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:32.799469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.799469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.799469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.799928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:32.799928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:32.812097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6ce2-10ad-4527-a6e5-2c18b2204016 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.812628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6ce2-10ad-4527-a6e5-2c18b2204016 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.813027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea6ce2-10ad-4527-a6e5-2c18b2204016 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.816474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 434/873] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:32.821172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:32.821461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:32.821735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:32.842742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:32.850695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:32.855615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:32.932319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 440/874] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:32 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:32.958019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 435/875] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:33.245010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:33.369522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a6391-cdc0-4d33-83b9-ef0b7aaac01e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:33.410096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:33.410758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.411035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.411307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.412006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:33.413664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b252a1c7-f6f4-4c5d-9511-78cd378e7b5d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:33.423980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:33.425131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:33.425982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 441/876] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:33.433434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:33.555990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edeab6-399f-49cf-8804-c5d51c65d559 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:33.561194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10bbf-1dd7-4618-a735-622e28bf369c None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.561509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10bbf-1dd7-4618-a735-622e28bf369c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.561743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10bbf-1dd7-4618-a735-622e28bf369c None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.563429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 442/877] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:33.571332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.571984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.572509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.593296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:33.594871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:33.602452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:33.603087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.603368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.603646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.604348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:33.604659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:33.606118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:33.613778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 436/878] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:33.619872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:33.625170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:33.648604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:33.696959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 443/879] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:33.762294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35922c70-fb98-4f3b-87b0-0ad6111498c4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:33.801401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:33.802453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.802956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.803441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.804335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:33.804873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:33.806645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3cdd1-82da-4164-9e7f-a7fee236c39b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:33.813364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 437/880] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:33.981684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:34.100459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308c3b-0a22-4d56-82bb-d3bd465d545b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:34.139708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:34.140379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:34.140660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:34.141014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:34.141701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:34.143173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67befe4-8209-45f3-adaf-9c56a3f0b35f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:34.230962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 444/881] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:33 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:35.402173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87fa7-d3e1-47be-bb14-5fd9560d6efc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:35.403261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87fa7-d3e1-47be-bb14-5fd9560d6efc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:35.403261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad87fa7-d3e1-47be-bb14-5fd9560d6efc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:35.405098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 438/882] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:35.411246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:35.411796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:35.411796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:35.433163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:35.434436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:35.466191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:35.551277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 445/883] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:35.884630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad87fa7-d3e1-47be-bb14-5fd9560d6efc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:35.965202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:36.007042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad87fa7-d3e1-47be-bb14-5fd9560d6efc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.050661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:36.051311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.051597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.051897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.052651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:36.054042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-800c9793-eeb7-4e15-9215-3f53c85c4291 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:36.065044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:36.066114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:36.066962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 439/884] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:36.072762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.077480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900c2d-f4d9-4bda-80bc-d3f45da2b362 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.077980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900c2d-f4d9-4bda-80bc-d3f45da2b362 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.078450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed900c2d-f4d9-4bda-80bc-d3f45da2b362 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.084423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 440/885] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:36.090908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.091400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.091875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.123730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:36.125985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:36.205892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcfe1e-2fde-4162-aaab-d39bcbd084f9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.259129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:36.259906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.260331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.260725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.261502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:36.261930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:36.263665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0df572-0b30-4dfa-945c-a95e003cde08 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:36.269841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 441/887] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:36.274506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 446/887] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:36.276304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.326137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88308f9-1223-476c-9830-b73ab29dc3e5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.326696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88308f9-1223-476c-9830-b73ab29dc3e5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.327173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88308f9-1223-476c-9830-b73ab29dc3e5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.330468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 447/888] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:36.337054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.337416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.338023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.361459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:36.363029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:36.386040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:36.404633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:36.465782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a1ea3-3cda-487c-a0da-693ab06f519b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.476097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 448/889] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:36 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:36.516486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:36.517606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.518099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.518584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.519478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:36.520020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:36.521712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:36.529101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 442/890] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:36.535443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.574172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.705683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e65af-f895-4b8d-950d-c80777b08d13 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.758103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e949-cc3c-4079-be85-ebb1263ceb23 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.773415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:36.774042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.774321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.774597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.775325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] RBAC: Adding query filter params (interface=public, service_id=e485c53640ff46ed925a8215c0b4159c, region_id=RegionOne) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:36.775634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:36.777236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:36.787402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 449/891] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:36 2022] GET /identity/v3/endpoints?service_id=e485c53640ff46ed925a8215c0b4159c&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:36.788245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.810051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:36.814424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:36.820180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:36.820880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:36.821157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:36.827465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:36.835435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:36.840910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:36.842113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 443/892] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:42:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:36.844971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:36.974077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344c2fd-36cb-4e02-9e8f-7122925d0958 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:36.997470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5444492-0feb-4ed8-847b-4d1e46d1e70f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.018879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.019460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.019792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.020194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.021208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.022831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe335a-a1c0-425d-87bb-2932bc843cd9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:37.037087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.044977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.044977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.044977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.044977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.044977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:37.047071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 444/893] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:36 2022] GET /identity/v3/services => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:42:37.047935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:37.110398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 450/894] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:36 2022] POST /identity/v3/services => generated 241 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:37.112242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece30d4-d309-4767-9502-cc24c59e0aaf None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.112775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece30d4-d309-4767-9502-cc24c59e0aaf None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.113256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece30d4-d309-4767-9502-cc24c59e0aaf None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.116254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 451/895] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:37.122918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.123832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.124634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.125189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:37.156466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:37.159163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:37.239126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06715cb8-cab3-4572-b1ef-6ec5f8e3b54b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.323452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.324435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.324913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.325388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.326685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:37.327319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.328988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 452/896] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:37.330904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:37.349465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 445/897] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:42:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:37.356398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:37.359800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:37.482196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2522fa3-ab0c-4ee2-a041-3155df1e79b8 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.532329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.533384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.533933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.534402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.547219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.549109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:37.577077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:37.578099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:37.578983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:37.578983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:37.578983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:37.581476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 453/898] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:37.587927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:37.709721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912f31c-acc6-4331-b73d-e88e83c2da4a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.729478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:37.751552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.752241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.752598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.752870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.753581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:37.753884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.755273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:37.775131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:37.775566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 446/899] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:37.800329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:37.876774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:37.932675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16114c7-0a1c-4b2f-8082-c5594580cbc0 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.964506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2093216-3781-4ef1-8ee9-e7648f140ffb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:37.977460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:37.977934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:37.978210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:37.978479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:37.988587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:37.990339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:38.003249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:38.004389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:38.005322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 454/900] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:38.010845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.043694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.045026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.045482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.045916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.046914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.049714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:38.068175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:38.070495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:38.072641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:38.079547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 447/901] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Sep 8 13:42:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:38.081708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.131003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:38.171336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d0254-43a9-4d87-a49a-3a11299c5bc5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:38.211873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:38.239798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.240726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.241112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.241620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.242355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:38.242763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.244386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.262054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398733d-a46a-49d4-b37a-95f9f61a95b2 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:38.273224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 455/902] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:38.280450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.345684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.347500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.348371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.349179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.350864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:38.351818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.354555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.372534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 448/903] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:38.376600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.419126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795e89b-1ca8-4cb4-a2ff-8bf0122469cb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:38.461929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.462879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.463160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.463469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.515110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:38.570348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:38.576822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.578383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6879f-c422-4fd4-9496-4f4af9670842 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:38.580517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.625745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.626517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.626634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.626936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.627583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:38.627888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.629919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.640397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 449/904] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:38.647088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.748707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 456/905] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:42:38.758857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.860458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d13fd-486c-432c-8611-b610997a6854 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:38.902791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:38.929356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:38.931336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.932138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.932878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.934471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] RBAC: Adding query filter params (interface=public, service_id=77df8bd99d7348a19d8f7b652e917e7d, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:38.935262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:38.938713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:38.951945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 450/906] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/endpoints?service_id=77df8bd99d7348a19d8f7b652e917e7d&interface=public®ion_id=RegionOne => generated 194 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:38.958913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:38.968036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11336-64d8-4380-b394-aada3a6fe0f3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:39.013392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:39.040044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:39.041643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.042712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.043438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.064851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:39.068329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:39.098687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:39.100525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:39.102236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:39.102236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:39.102236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:39.105975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 457/907] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:39.113753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:39.174600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbf67e-f8e7-43ec-8432-58867122d898 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:39.247230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:39.248235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.248698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.249159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.250186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:39.253433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:39.272393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 451/908] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:38 2022] GET /identity/v3/services => generated 1497 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:42:39.341031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8d832-a0bb-4505-a373-cca9ca35c0ad None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:39.396691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:39.417656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:39.418735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.419297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.419717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.420943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:39.421460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:39.424273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255ee6e-7d33-4a63-b005-74fe3d46d9c0 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:39.444726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 458/909] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:39.451654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:39.571394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19167-f6d9-4e0f-898d-3e9b97c4dfb6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.571915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19167-f6d9-4e0f-898d-3e9b97c4dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.571915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19167-f6d9-4e0f-898d-3e9b97c4dfb6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.574901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 459/910] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:39.581612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.582110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.582623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.593884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:39.613716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a785c-1e8d-4b56-b21d-d634a46a932a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:39.614430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:39.616489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:39.693688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:39.694915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.695473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.696258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.713360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:39.720403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:39.737517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 460/911] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0775ab30-76c4-4e43-96f2-4fe569b9760d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:39.758950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:39.760770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:39.762636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:39.766498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 452/912] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:39.776387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:39.991815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a4dc8-f8eb-473b-863e-a7a5dfadc9eb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.022492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:40.035931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac75b-30b9-4cea-9d3b-399b7983287d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.036433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac75b-30b9-4cea-9d3b-399b7983287d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.038644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac75b-30b9-4cea-9d3b-399b7983287d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.040977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 453/913] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:40.052259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.052963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.053597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.062908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:40.063789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.064244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.064657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.065517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:40.066001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:40.067762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:40.081972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 461/914] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:40.085340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:40.091240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:40.102074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:40.232239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d694c-3a10-4b7d-8bbb-bd8fa9360c27 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.233232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 454/915] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:40.270361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:40.270981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.271331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.271649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.272436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] RBAC: Adding query filter params (role.id=935b50a2adce43b6b49baf71b72c3dbe, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=340fc101f9434628ba59243d6968163a) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:40.272870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:40.273886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:40.274340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:40.281734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 462/916] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:40 2022] GET /identity/v3/role_assignments?user.id=340fc101f9434628ba59243d6968163a&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=935b50a2adce43b6b49baf71b72c3dbe => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:40.453602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:40.498300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab622f-4ede-42d2-be22-e86fdc2ae458 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.572245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:40.572245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.572245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.572245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.572916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:40.574866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:40.592934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:40.594764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:40.596397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 455/917] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:40.609657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:40.674651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:40.752571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae275a-b422-4c92-ac85-18cbe99d4f27 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.759191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:40.804051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:40.805123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:40.805792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:40.805981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:40.806582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:40.806893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:40.809185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:40.817411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 463/918] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:40.826676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:40.966938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f691-2602-4f57-93c1-6698f67f03b6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.973526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f9c5f-fa9b-4c1c-abd8-8c8357259e00 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:40.984859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:41.017727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.018433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.018706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.018972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.019958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:41.020341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.022409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.030081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 464/919] 10.222.0.96 () {56 vars in 1114 bytes} [Thu Sep 8 13:42:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:41.039829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:41.041765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.048188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.048188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.048188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.048188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.048188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:41.067214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:41.069304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:41.071021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 456/920] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:41.086175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:41.104619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:41.273051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1dac9-7b51-4e90-a585-1e6338a6ff79 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:41.324025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6db7-cbd8-4923-aca2-afb7d7cd8cb9 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:41.358527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.360560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.361384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.362776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.364419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.367437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191a6e9-340c-4a5a-8536-533627fd2b09 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.400774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.402300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.403051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.403801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.405299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:41.406220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.408975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.427944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 457/921] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:41.429736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:41.496826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 465/922] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:41.565555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:41.639012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d38c92-d32f-481d-b09a-16ac69601dc0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:41.726054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.727148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.727590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.728025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.729170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:41.729641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.732504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c08890-9d2c-4e2a-9808-564b233b1784 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.732989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c08890-9d2c-4e2a-9808-564b233b1784 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.733095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.733175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c08890-9d2c-4e2a-9808-564b233b1784 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.734764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 466/923] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:41.740602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.740903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.741163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.744159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 458/924] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:41.751288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:41.769529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:41.771593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:41.800769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:41.863365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 467/925] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:41.882620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3092-b0fc-4d7b-8f5c-c4c6e96f316a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:41.918010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:41.924286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:41.924909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:41.925195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:41.925458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:41.926164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] RBAC: Adding query filter params (interface=public, service_id=2426a54f98ab4ccd91bfda58b8db8402, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:41.926472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:41.927909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:41.934278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 459/926] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:41 2022] GET /identity/v3/endpoints?service_id=2426a54f98ab4ccd91bfda58b8db8402&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:41.939888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:42.059908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9c860-c3a3-4af8-a1fc-6ff0412e34e7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:42.101740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:42.102434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:42.102709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:42.102965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:42.104244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:42.105190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:42.116748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 468/927] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:41 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:42:42.367273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:42.566427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32128b-10c8-4ddc-a87d-370a18779ee4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:42.631158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:42.631732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:42.632006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:42.632337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:42.632933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:42.634380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:42.645311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:42.647544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:42.649646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 460/928] 10.222.0.96 () {56 vars in 1132 bytes} [Thu Sep 8 13:42:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:42.664490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:42.686615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:42.841837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08a16a-0a21-4eb6-8612-cee9c4d3a92f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:42.882521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:42.883072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:42.883355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:42.883635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:42.884327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:42.884639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:42.886106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:42.892093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 469/929] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:42.901068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:43.016466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:43.104621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d83ca-afd3-425c-9064-25de627a5970 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:43.148855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:43.149393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:43.149672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:43.149944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:43.150594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:43.150899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:43.153107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b98c57-2fbf-4935-898b-672e6b43e183 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:43.160019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 461/930] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:43.169947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:43.183381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19cfc-a834-4202-b8b3-a8670613e78a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:43.183381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19cfc-a834-4202-b8b3-a8670613e78a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:43.183381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c19cfc-a834-4202-b8b3-a8670613e78a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:43.183381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 462/931] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:43.189942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:43.190579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:43.191067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:43.217997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:43.219591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:43.305557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:43.333949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49c34a-be12-4d43-b27d-ad3a85314916 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:43.362435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 463/932] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:43.398122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:43.398637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:43.399274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:43.399765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:43.401065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:43.403771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:43.517986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 470/933] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:43.648628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:43.768868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:43.872679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5dbb2-fa1c-42e2-afc4-822e3332cfb1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:43.953785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:43.954442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:43.954730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:43.955013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:43.969330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2a489291-fe0f-4f85-bbcd-c106723e15ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:43.974446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:43.975587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:43.976504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 464/934] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:42:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:43.986443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:44.059136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6930-3d4a-43c2-92fb-51b8fb09dce4 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.059462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6930-3d4a-43c2-92fb-51b8fb09dce4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.060294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e6930-3d4a-43c2-92fb-51b8fb09dce4 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.062103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 465/935] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:44.071095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61bbe4-c17d-4f83-bc6b-42a628572674 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.071580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61bbe4-c17d-4f83-bc6b-42a628572674 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.072059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61bbe4-c17d-4f83-bc6b-42a628572674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.104537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6f61bbe4-c17d-4f83-bc6b-42a628572674 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:44.107222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6f61bbe4-c17d-4f83-bc6b-42a628572674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:44.142407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240f30-eaea-4466-b50c-f01782560218 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:44.184414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:44.185046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.185324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.185600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.186285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:44.186590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:44.188167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:44.191014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:44.201089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 471/936] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:42:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:44.207441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:44.248282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 466/937] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:44.405042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fdeaa-35db-46b5-9236-f0407a636bea None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:44.480629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:44.482146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.482875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.483634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.505981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:44.509385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:44.527757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a379f6-dcb5-49cc-b904-b26e76e97755 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.528222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a379f6-dcb5-49cc-b904-b26e76e97755 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.528623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a379f6-dcb5-49cc-b904-b26e76e97755 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.530679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 467/938] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:44.535022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a379f6-dcb5-49cc-b904-b26e76e97755 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-ff7d5082-6c61-4da8-8cbf-2a6b9a1adeaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:44.545635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:44.546658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:44.547543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:44.547543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:44.547543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:44.553046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 472/939] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:44.553046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.553046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.553046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.583155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:44.585306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:44.586662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:44.665570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a379f6-dcb5-49cc-b904-b26e76e97755 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:44.681989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:44.712988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:44.713945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 473/940] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:44.714664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:44.715014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:44.715505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:44.716694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:44.718216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:44.719710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:44.724488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING keystone.server.flask.common [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 13:42:44.795050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.sql.core [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:42:44.795050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:42:44.795050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [parameters: {'id': '120e9a68118d451382beb395e75e9193', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:42:44.795050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 120e9a68118d451382beb395e75e9193.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 120e9a68118d451382beb395e75e9193. Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:42:44.826316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 13:42:44.828009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application yield resource Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise self.value Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application session.commit() Sep 08 13:42:44.834428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:42:44.838058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:42:44.842603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:42:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [parameters: {'id': '120e9a68118d451382beb395e75e9193', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:44.850682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:44.855452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 120e9a68118d451382beb395e75e9193. Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 468/941] 10.222.0.96 () {60 vars in 1140 bytes} [Thu Sep 8 13:42:44 2022] POST /identity/v3/projects => generated 262 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:44.860798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:44.974453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39be76-40be-46bf-a281-c03d7d52df60 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.044033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.045091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.045511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.045981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.047355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:45.047882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.050445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.061755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.072014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f25c5-b6bc-44ab-b336-fe9a7c889384 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.076463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 474/942] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:45.077495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.120889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.122195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.122475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.122755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.131681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.133468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.154687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:45.156967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:45.158668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 469/943] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:45.161339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.237072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46c1de-4f93-4011-a4d8-76317bb9ec7e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.301796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.302844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.303296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.303724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.304405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.306331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:45.322404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:45.325000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:45.327721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 475/944] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:45.330890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.363548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c3ca-383f-482b-a0b9-833b0828e447 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.440517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.441880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.442513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.443138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.459560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.462747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:45.480626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:45.482491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 470/945] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:45.484463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.498907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd050bb-4432-46db-bc62-ffef512958f5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.505600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.511458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.570979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.571919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.572407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.572835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.574491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:45.574957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.576889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.604255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 476/946] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:45.604255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.666061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c3e0a-5f72-49fc-8168-9d534dd1db1f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.718604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.719545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.719831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.720109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.720817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:45.721126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.722907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.734860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 471/947] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:45.744944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.813491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdc80c-27a7-4fff-a8a3-300479167581 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:45.870154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:45.871544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:45.872395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:45.872731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:45.873599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:45.873995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:45.875626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:45.908241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 477/948] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:45.912756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:45.926995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.966401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:45.969607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbe05a-1176-48cf-ad20-6d916ba830ef None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.043975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.045132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.045636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.046138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.047325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:46.047867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.050556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8846c-7700-43fc-853c-3bf94b416a7c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:46.059830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 472/949] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:46.062103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45875cf-d58b-402d-83f4-018256a7c31e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.062716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45875cf-d58b-402d-83f4-018256a7c31e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.063195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45875cf-d58b-402d-83f4-018256a7c31e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.068599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 473/950] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:46.068599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45875cf-d58b-402d-83f4-018256a7c31e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:46.081504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ef82a-edf7-468b-b560-d182ffaa6a30 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.138298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.139342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.139819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.140339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.160094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.163264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-eb47bf55-d8a5-4dda-9c63-9c31afbadbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:46.189375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:46.190590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:46.191622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:46.191622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:46.191622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:46.191622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 478/951] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:46.193577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.194079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.194574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.208123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45875cf-d58b-402d-83f4-018256a7c31e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.225592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:46.227688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:46.251385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.252443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.252924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.253701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.254625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.257020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:46.326734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:46.334659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 474/952] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:42:46.344602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:46.345250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:46.368243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 479/953] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:46.530508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a9c1d-e171-4546-a882-c52c545fa0cc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.596113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.597047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.597427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.597799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.598629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:46.599035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.600630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:46.619612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 475/954] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:46.630166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:46.704613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:46.791095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430fd00-3467-42dc-abcd-2e8bbc8c2049 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.837365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.838102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.838516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.838676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.848542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.849972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:46.865246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:46.867146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:46.869176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:46.871272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 480/955] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:46.872901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:46.875871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:46.939623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d7969-9b64-43c1-aff2-05a1d8790406 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:46.986688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:46.987500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.987899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.988478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.989120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:46.990734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:47.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:47.003771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:47.005505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 476/956] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:47.014236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:47.021361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:47.096899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba03dc-07c8-40cd-baed-85a5de1ce35e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:47.159016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:47.160531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:47.161161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:47.161888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:47.163382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:47.164311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:47.167698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.200891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 481/957] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:47.205163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:47.224755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df091112-18d8-4054-b536-08e38e0c6c79 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:47.266082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:47.279753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:47.296374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.297254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 477/958] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:47.302064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:47.420944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1e9c9-b97f-49d4-969b-82ed872d03d8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:47.435602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3e336-6691-4fbd-84ea-4094d9dec782 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:47.463054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:47.491424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:47.492721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:47.493207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:47.493679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/340fc101f9434628ba59243d6968163a/roles/935b50a2adce43b6b49baf71b72c3dbe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:47.497864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=340fc101f9434628ba59243d6968163a, role_id=935b50a2adce43b6b49baf71b72c3dbe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:47.501050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a5b5a-3cee-4fd3-8797-9c04da5a671d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.512908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:47.513950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:47.514433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:47.514899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:47.516028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:47.516745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:47.519418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437597c6-774b-4fb5-98ad-10fc9eade193 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.532295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 478/959] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:47.602854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 482/960] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:42:47 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/340fc101f9434628ba59243d6968163a/roles/935b50a2adce43b6b49baf71b72c3dbe => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:42:48.684001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f386-ef7f-42ba-9ba8-00061c8fdd3d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:48.684584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f386-ef7f-42ba-9ba8-00061c8fdd3d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:48.685000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f386-ef7f-42ba-9ba8-00061c8fdd3d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:48.688110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 479/961] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:48.697540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:48.698137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:48.698537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:48.731234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:48.733382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:48.869418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 483/962] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:49.389898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f386-ef7f-42ba-9ba8-00061c8fdd3d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:49.454774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:49.520676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f386-ef7f-42ba-9ba8-00061c8fdd3d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:49.574017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:49.580247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:49.580247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:49.580247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:49.580247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:49.580247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:49.641262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.sql.core [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:42:49.641262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:42:49.641262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [parameters: {'user_id': 'f3ddfd132e1d4b388a5a4c7c5ff0def0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:42:49.641262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5f7116e7-4ae8-4837-a32c-a66110ada692 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Sep 08 13:42:49.667822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:42:49.669934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application yield resource Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise self.value Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application session.commit() Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:42:49.672272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:42:49.674329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:42:49.676754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application result.read() Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:42:49.680146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f3ddfd132e1d4b388a5a4c7c5ff0def0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:49.689720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 13:42:49.691815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:49.694867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 480/963] 10.222.0.96 () {60 vars in 1131 bytes} [Thu Sep 8 13:42:49 2022] POST /identity/v3/users => generated 160 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:49.701224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:49.724175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b263a-1421-4073-b8c2-3730b49d77f9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:49.724583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b263a-1421-4073-b8c2-3730b49d77f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:49.724929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b263a-1421-4073-b8c2-3730b49d77f9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:49.730430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 481/964] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:49.736187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:49.736589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:49.736933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:49.757582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:49.759316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:49.827005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87fdc0-94d9-482f-be11-83d2825cb7f2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:49.841246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:49.870940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:49.871683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:49.872027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:49.872393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:49.877467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 482/965] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:49.886669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:49.889513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:49.915505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:49.917440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:49.920431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 484/966] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:42:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:49.928243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:50.012652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:50.095503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c31111-6fb5-4328-8649-debbce411723 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:50.160350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:50.165689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:50.166260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.166526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.167287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.168021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:50.168363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:50.170079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c504184-d33f-4808-b243-1a503d75c126 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:50.210591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 483/967] 10.222.0.96 () {56 vars in 1101 bytes} [Thu Sep 8 13:42:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:50.316004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84f3c-6072-45a4-ad2e-accd8768e3f1 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.316995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84f3c-6072-45a4-ad2e-accd8768e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.317507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84f3c-6072-45a4-ad2e-accd8768e3f1 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.327782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 484/968] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:50.330648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.331481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.332304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.366535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:50.369551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:50.374516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2cbd0-5e36-4647-8d4a-63dcf1811a79 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:50.445019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:50.446035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.446523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.447337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.453589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:50.456241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:50.472042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:50.473311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:50.474156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:50.476978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 485/969] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:50.488680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:50.522559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 485/970] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:50.540176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:50.647552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc5b01-c72e-44a6-bb05-8663160daafd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:50.694189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:50.694826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.695189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.695454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.696084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:50.696453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:50.697920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaf03b-30a9-4dc5-b853-0ced1f9e31a1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:50.704139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 486/971] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:50.710520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:50.758415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:50.868387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f003-e0ad-4bac-9da1-f8207bfa5982 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.868751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f003-e0ad-4bac-9da1-f8207bfa5982 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.868943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f003-e0ad-4bac-9da1-f8207bfa5982 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.870539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 487/972] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:50.876227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.876561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.876776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.878539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5f577-087f-48da-87b4-98b298d672bf None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:50.897219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:50.898457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:50.947027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:50.948535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:50.948953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:50.949396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:50.950398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:50.950912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:50.953487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:50.968425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 486/973] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:50.970960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:50.982176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 488/974] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:51.019864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:51.069519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:51.144033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:51.156914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e7414-ee26-4b13-8c02-7f915419fbc5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:51.208798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf01f00-a8b4-489b-8efb-9525425c0d54 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:51.213243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:51.215619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:51.216076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:51.216578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:51.218299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] RBAC: Adding query filter params (interface=admin, service_id=2426a54f98ab4ccd91bfda58b8db8402, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:51.218863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:51.221610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:51.236606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 487/975] 10.222.0.96 () {56 vars in 1249 bytes} [Thu Sep 8 13:42:50 2022] GET /identity/v3/endpoints?service_id=2426a54f98ab4ccd91bfda58b8db8402&interface=admin®ion_id=RegionOne => generated 193 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:51.238596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:51.285892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:51.289613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:51.290169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:51.290655 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:51.292511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:51.297937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:51.377116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5ad78-1bd0-4d01-a207-f523c2f99020 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:51.380283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 489/976] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:51 2022] POST /identity/v3/services => generated 242 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:42:51.381967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:51.458649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:51.459843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:51.460287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:51.460763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:51.462129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:51.465404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:51.488260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 488/977] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:51 2022] GET /identity/v3/services => generated 1727 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:42:51.550368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:51.579764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166b9ce-3c13-4a48-87b6-a1c60ddb0a5d None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:51.658741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:51.659490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:51.659835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:51.660240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:51.678336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:42:51.684430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:51.686438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:51.688315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 490/978] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:42:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:51.696071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:51.720100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:51.863585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160faa9d-6d5a-4cd0-a6ce-e93e9b3f5047 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:51.927548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:51.928318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:51.928676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:51.929037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:51.929885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:51.930250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:51.931724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:51.943073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 489/979] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:42:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:51.949973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:52.154739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3815-5c75-4cdc-82ad-210b6d0a1f64 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:52.224367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:52.225716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:52.226325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:52.226918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:52.247899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:52.250818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:52.267483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:52.281290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:52.287188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:52.289211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:52.289211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:52.289211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:52.289211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 491/980] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:52.293608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:52.398847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:52.423033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b8630-01a5-44c3-83a7-6ae42aedfdfb None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:52.465951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:52.466591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:52.466872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:52.467245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:52.468007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:52.468351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:52.469726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:52.487878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 490/981] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:52.494583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:52.633823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606f692-4736-42ea-aafb-22c5c9c193ae None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:52.684560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:52.685205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:52.685483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:52.685752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:52.695137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:52.696705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:42:52.709939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:52.717239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:52.719230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 492/982] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:42:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:52.726727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:52.920368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bd37b-713f-48b9-a00f-4d15d9faf932 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:52.985708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:52.986652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:52.987128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:52.987611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:52.989024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:52.989566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:52.992525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:53.011064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:53.022325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 491/983] 10.222.0.96 () {56 vars in 1149 bytes} [Thu Sep 8 13:42:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:53.031798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:53.126555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:53.203506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e9f0c-d84b-4228-9eae-a3790b3642c9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:53.275141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:53.276021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:53.276471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:53.277012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:53.374826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:53.376324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:53.441874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:53.489516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 493/984] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:42:53 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:42:53.496185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:53.615113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c025191-5d47-41ec-981f-84a1ff663ccc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:53.664809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:53.665630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:53.665789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:53.666036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:53.681312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:53.682886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:42:53.700260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:53.702058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:42:53.703797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:42:53.703797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:42:53.703797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:53.705135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 492/985] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:53.707787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:53.852245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22991a9e-b8e3-4adb-a4f6-86ce228bfd17 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:53.915724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:53.916418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:53.916705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:53.916973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:53.917662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:53.918090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:53.919462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef241faf-d658-46f4-8d17-17f2a8528c24 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:53.933909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 494/986] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:53.939707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:53.959469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2a2a-aae9-452e-b742-124d50b76a71 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:53.959753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2a2a-aae9-452e-b742-124d50b76a71 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:53.960011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b2a2a-aae9-452e-b742-124d50b76a71 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:53.961452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 495/987] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:53.968343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:53.968620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:53.968880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:53.988958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:53.990647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:54.019115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:54.039116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:54.110950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00178582-92dd-4e1c-abd9-12999453fd52 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:54.114703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 496/988] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:54.188916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:54.189975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.190463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.191001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.205323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:54.208173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:42:54.233215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:54.234997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:54.236844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 493/989] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:54.242259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:54.380539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3924c07-b700-4fb7-9d0a-56937f2b6a05 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:54.428794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:54.429540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.429819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.430092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.430902 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:54.431244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:54.433694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:54.450200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 497/990] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:54.457310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:54.543181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:54.567799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:54.632741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e26346-06bf-4847-8f48-282ea4bdb6f5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:54.646555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:54.678016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:54.678735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.679015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.679291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.680120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] RBAC: Adding query filter params (role.id=935b50a2adce43b6b49baf71b72c3dbe, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=340fc101f9434628ba59243d6968163a) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:54.680461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:54.682493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea9e14-e2a8-485b-8e2d-02d185772dc0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:54.690140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 494/991] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:42:54 2022] GET /identity/v3/role_assignments?user.id=340fc101f9434628ba59243d6968163a&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=935b50a2adce43b6b49baf71b72c3dbe => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:54.691465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bcf9e-fa3d-4157-a081-5763435bcfa6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.691835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bcf9e-fa3d-4157-a081-5763435bcfa6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.692113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bcf9e-fa3d-4157-a081-5763435bcfa6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.696463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 495/992] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:54.700602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.701262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.701736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.711172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e711906-0cc9-463a-a62d-9bb659f029b5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:54.734876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:54.737229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:54.764706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:54.765380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.765701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.766006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.766560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:54.768154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:54.779008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:54.781016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:54.782638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 498/993] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:54.795472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:54.868844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 496/994] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:54.947780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:54.995093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df9f6a-29f2-4e0e-a192-f00cb2402dc6 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.066709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.067814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.068317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.068888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.070316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:55.070835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.073534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.088986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 499/995] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:55.094780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.133400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.245915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82174dcf-75cc-4e01-a4e9-8364f608d5d2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.250482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:55.295241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.296221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.296534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.296812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.297463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] RBAC: Adding query filter params (type=compute) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:55.297766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.299502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.310740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 497/996] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:55.316899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.334231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257c0a1-9256-4065-8a6c-787301bac200 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.381932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.382589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.382877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.383153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.383758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.385740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:55.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:55.403876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:42:55.405647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:55.408692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 500/997] 10.222.0.96 () {56 vars in 1126 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:55.413738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.419488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:55.522880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75d6ae-3218-482f-b315-ed7cf6f3642e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.585323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.586377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.587134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.587594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.589312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] RBAC: Adding query filter params (interface=public, service_id=609de806a1c74d9d89b4ff7be3e15455, region_id=RegionOne) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:55.589769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.592490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.602451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 498/998] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/endpoints?service_id=609de806a1c74d9d89b4ff7be3e15455&interface=public®ion_id=RegionOne => generated 194 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:55.611135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.613451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385aae9-a3ea-4cc3-b622-75da4a3ef802 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.668982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:55.681318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.683383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.683914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.684469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.685670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:55.686219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.689031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.707918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 501/999] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:55.709096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:55.777478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85b42-f85e-47c5-93d4-2b195ec9b621 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.836389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:55.839174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.840267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.840780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.841240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.842333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.844860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:55.868239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 499/1000] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/services => generated 1727 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:42:55.910382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff62e2-979b-4d4f-a770-25bcda89669c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:55.985385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:55.986518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:55.986992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:55.987469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:55.988737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:55.989286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:55.991984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d9cc1a-d6bb-42e4-a5f1-32f67e8361f7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:56.003201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 502/1001] 10.222.0.96 () {56 vars in 1122 bytes} [Thu Sep 8 13:42:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:56.013259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:56.178903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:56.191520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0b6a1-0867-41d1-84d2-6c1a66b947df None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:56.259003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:56.260159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:56.260702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:56.261185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:56.262639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:56.265575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78815d72-3aeb-4d70-bdda-418180ea52d4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:56.389876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 500/1002] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:42:57.793963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e437e-b986-4390-9329-0a83211113da None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:57.794745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e437e-b986-4390-9329-0a83211113da None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:57.795109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e437e-b986-4390-9329-0a83211113da None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:57.797853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 503/1003] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:57.807953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b686-dc6b-455b-9ab1-5901c48f582d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:57.808805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b686-dc6b-455b-9ab1-5901c48f582d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:57.809143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4b686-dc6b-455b-9ab1-5901c48f582d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:57.841769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2fc4b686-dc6b-455b-9ab1-5901c48f582d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:57.843708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2fc4b686-dc6b-455b-9ab1-5901c48f582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:57.996187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 501/1004] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:58.192039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f45d-714d-4f27-b299-c0e87fd627b1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.192348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f45d-714d-4f27-b299-c0e87fd627b1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.192500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638f45d-714d-4f27-b299-c0e87fd627b1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.194157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 504/1005] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:58.200351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.200773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.200954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.223178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:58.224178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:58.309192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 502/1006] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:42:58.503478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638f45d-714d-4f27-b299-c0e87fd627b1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:58.586223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:58.604841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:58.708330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638f45d-714d-4f27-b299-c0e87fd627b1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:58.746464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab11f3-be3a-40d7-b2c1-af22a7a2e9ba None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:58.753953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:58.762300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:58.762975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.763248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.763530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] PATH_INFO: `/v3/services/image` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.764140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:58.767143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-5dc1d5ec-e56f-4fb6-8550-4ff80a6851ac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:58.776063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:58.778101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:42:58.779366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 505/1007] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Sep 8 13:42:58 2022] GET /identity/v3/services/image => generated 86 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:42:58.780170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac9da-8e20-4904-a68e-77c07e5051b8 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.780170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac9da-8e20-4904-a68e-77c07e5051b8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.780170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ac9da-8e20-4904-a68e-77c07e5051b8 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.781629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 506/1008] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:58.787349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.787645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.787898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.797150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:58.798150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:58.798597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:58.799035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] PATH_INFO: `/v3/services/compute` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:58.799990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:58.802392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:58.814580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:58.816607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:42:58.817968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:42:58.820430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:42:58.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:42:58.828228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 503/1009] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:42:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:42:58.830087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:58.934997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 507/1010] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:42:58.936356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:58.959683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:58.991060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb284a-ccfd-413e-be08-b5a691dc394d None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.048598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.049708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.050328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.050792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.052041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] RBAC: Adding query filter params (name=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:59.052629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.055343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.066053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 504/1011] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:59.072063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:59.142711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf37bb3-e945-42f4-a9c5-b268e17ffc77 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.180991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:59.194638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.196463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.196463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.196463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.196802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] RBAC: Adding query filter params (name=compute) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:59.196932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.198426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.208701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 508/1012] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:42:59.212430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:59.259419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3e005-261e-4659-9742-98986aff3467 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.323782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.324475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.324955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.325298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.326161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] RBAC: Adding query filter params (type=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:59.326469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.328593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.337802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 505/1013] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:59.365974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:59.372741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:59.383767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41847-76d1-4b7b-9caf-f549c0aaa38a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.451049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.451951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.452510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.452947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.454001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:42:59.454502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.456030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.463579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 509/1014] 10.222.0.96 () {56 vars in 1112 bytes} [Thu Sep 8 13:42:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:59.470458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:59.541729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ed2ac-b82f-46ab-9d60-1052a7d5109a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.571818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:59.609858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.610940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.611415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.611899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.614021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.616899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.620182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 506/1015] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:42:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:42:59.628077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:59.661357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d83b7-edca-41ad-91ce-d8e3110ccc9c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.729433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.730463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.730944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.731411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.732712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.735400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa06b2-2719-493a-8f91-7df4f3c3cf82 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.767159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:59.805305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57210c6-4d50-41ff-9f50-0631a6e6ac0c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:59.847495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:59.848634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:59.848634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:59.848924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:59.849582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:59.851186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c019a6-a403-4af5-8581-efe48f14b57e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:59.919271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 510/1016] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:42:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:00.048892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 507/1017] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:42:59 2022] POST /identity/v3/projects => generated 311 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:01.737502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62da6c-5eb5-4547-a7b0-a50c66d765c6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:01.738362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62da6c-5eb5-4547-a7b0-a50c66d765c6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:01.738362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62da6c-5eb5-4547-a7b0-a50c66d765c6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:01.739794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 511/1018] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:01.746093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c3f7-a0ab-4ca9-a2d5-fddcdc9b1350 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:01.746905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c3f7-a0ab-4ca9-a2d5-fddcdc9b1350 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:01.746905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580c3f7-a0ab-4ca9-a2d5-fddcdc9b1350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:01.768222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4580c3f7-a0ab-4ca9-a2d5-fddcdc9b1350 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:01.769534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4580c3f7-a0ab-4ca9-a2d5-fddcdc9b1350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:01.861011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 508/1019] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:01 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:02.134153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62da6c-5eb5-4547-a7b0-a50c66d765c6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:02.282911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62da6c-5eb5-4547-a7b0-a50c66d765c6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:02.303039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:02.354667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:02.356474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:02.357302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:02.358104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:02.359736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:02.362843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:02.377071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230c12-088c-4249-9a9b-e167a53393bf None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:02.377594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230c12-088c-4249-9a9b-e167a53393bf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:02.378225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e230c12-088c-4249-9a9b-e167a53393bf None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:02.380472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 509/1020] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:02.389918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:02.390320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:02.390734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:02.413644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:02.415256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:02.486635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:02.511175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 512/1021] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:43:02 2022] POST /identity/v3/services => generated 242 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:02.542888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 510/1022] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:02.830808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:02.952550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72408c-8adc-4dc2-8707-93c35fe8d6d3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:02.997882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:02.998675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:02.998856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:02.999121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.013291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:03.018359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:03.024735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:03.026252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 513/1023] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:43:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:03.030762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.167925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4f04f-8279-44ff-9c62-75b9b2b28030 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:03.210587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:03.211202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.211731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.212024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.215543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:03.215543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:03.215543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529e3ad-7d1f-4b38-aa34-fdc57c34d213 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:03.225572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 511/1024] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:43:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:03.232288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.291971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:03.366230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c683-3eb1-400c-a43c-8079b9203fc8 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.366543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c683-3eb1-400c-a43c-8079b9203fc8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.366818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6c683-3eb1-400c-a43c-8079b9203fc8 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.368177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 512/1025] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:03.374514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.374801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.375134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.397299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:03.398600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:03.415073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ae-df14-4962-bd56-0a1ca42c5d64 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:03.442075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:03.463375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:03.464016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.464307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.464582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.477362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:03.478875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:03.492419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 513/1026] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:03.497432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:03.499373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:03.502101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:03.502101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:03.502101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:03.503990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 514/1027] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:03.506080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.701872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c47103-9921-4870-9caf-8ec12d1a3890 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:03.766695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.770257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:03.772972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.773396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.773871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.775126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:03.775676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:03.779440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:03.797770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 514/1028] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:03.808043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.857685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:03.880003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:03.903013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb42a66-e8e7-4b17-8d82-ac55846cfe5f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:03.954402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:03.955634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:03.956131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:03.956645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:03.958679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:03.961790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:03.968517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 515/1029] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:03.972051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:03.976815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae8221-29f0-4bfd-a551-221c9e5cf55b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:04.027721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:04.028836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.029357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.029831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.045883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:04.048785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:43:04.069505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:04.070599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:04.071546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:04.072163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 515/1030] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:43:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:04.078418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:04.113797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854a2e2-bd1d-4c78-bd74-76f97f0e16fb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:04.156552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:04.157507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.157773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.158056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.158740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:04.160313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:04.187835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:04.200675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9123ec-0521-4a2c-8bf6-68240dd21c81 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:04.244888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:04.244888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.244888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.244888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.245342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:04.245342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:04.245342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:04.263603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 516/1031] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:43:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:04.269787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:04.337244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 516/1032] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:43:03 2022] POST /identity/v3/users => generated 285 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:04.397718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fa317-df97-4e51-8ab6-d53c24dcff54 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:04.444702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:04.445330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.445605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.445877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.468180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:04.563029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:04.566289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:04.736257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 517/1033] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:43:04.740612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:04.747479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:04.939470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d71e5-524d-4207-bd71-46ddf2241521 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:05.004440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:05.005555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.006043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.006519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.027623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:05.030535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:05.059704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:05.060797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:05.061789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:05.061789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:05.061789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:05.062613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 517/1034] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:05.071896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:05.164370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:05.243693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145043ab-b92a-4510-8ec4-74f0f38bf71b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:05.288565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:05.289218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.289581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.289859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.290587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:05.290891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:05.292417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:05.306929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 518/1035] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:05.313495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:05.405191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:05.478088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e60592-8439-4941-b825-d6ca913b0669 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:05.545319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:05.546422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.546931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.547283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.561909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:05.561909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-821f74b8-8210-40fe-a91b-39fbc023b911 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:43:05.588395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:05.590277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:05.598465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 518/1036] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:43:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:05.604619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:05.614659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e496-b10b-4fba-bb0c-7a27a0380528 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.615094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e496-b10b-4fba-bb0c-7a27a0380528 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.615495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6e496-b10b-4fba-bb0c-7a27a0380528 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.617504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 519/1037] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:05.625106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.625523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.625916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.649620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:05.651208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:05.755383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 520/1038] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:05.814746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e173e58-a737-40be-841e-00b87cf5bb93 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:05.831655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:05.883242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:05.884885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:05.885364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:05.885850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:05.886805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:05.887117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:05.889513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:05.920248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 519/1039] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:05.925913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:06.020968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:06.128744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea682-4647-41fd-aaa0-056c93044855 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:06.142666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:06.183714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:06.184369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:06.184675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:06.185801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:06.186584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] RBAC: Adding query filter params (role.id=935b50a2adce43b6b49baf71b72c3dbe, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:06.186921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:06.188840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:06.204265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 521/1040] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:05 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=935b50a2adce43b6b49baf71b72c3dbe => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:06.347276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c219-bac8-46fb-8cc5-7578b49e953c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:06.418478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:06.419504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:06.420009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:06.420525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] PATH_INFO: `/v3/services/image` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:06.421628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:06.424289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:06.442105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:06.443269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:06.444128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:06.450506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 520/1041] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Sep 8 13:43:06 2022] GET /identity/v3/services/image => generated 86 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:06.451945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:06.593953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715090b-5884-4a41-968e-0fef397a6a71 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:06.610171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:06.640253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:06.640877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:06.641283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:06.641456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:06.642114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] RBAC: Adding query filter params (name=image) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:06.642623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:06.644028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:06.652290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 522/1042] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:06.664821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:06.721353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:06.834760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41cebbb-0b75-4e01-81af-4a66bb309e75 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:06.906080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:06.907293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:06.907891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:06.908517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:06.909952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:06.910631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:06.913427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61237af3-5935-4275-ac04-2038297e41b9 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:06.929092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 521/1043] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:06.931129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:06.991484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7974-4113-446b-95b2-c7a372c29269 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:06.991744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7974-4113-446b-95b2-c7a372c29269 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:06.992080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7974-4113-446b-95b2-c7a372c29269 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:06.995050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 522/1044] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:07.001440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:07.001721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:07.002043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:07.023516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:07.024822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:07.125621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147daa-b23d-4895-a19c-d3011034c910 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:07.148747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 523/1045] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:07.194833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:07.195859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:07.196387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:07.197420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:07.198664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] RBAC: Adding query filter params (interface=public, service_id=11449610ef3042bf92d9c0705200c09b, region_id=RegionOne) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:07.199165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:07.201793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:07.220162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 523/1046] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:43:06 2022] GET /identity/v3/endpoints?service_id=11449610ef3042bf92d9c0705200c09b&interface=public®ion_id=RegionOne => generated 194 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:07.223569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:07.276701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:07.426397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403e6e1-31e0-4b4e-9a81-962ab4cc3ef5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:07.453524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:07.494597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:07.496076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:07.496609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:07.497098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:07.498249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:07.500966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:07.512440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:07.524242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 524/1047] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:43:07 2022] GET /identity/v3/services => generated 1957 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:43:07.604406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834fd94-5a46-42c1-a0e5-91f86cb5718c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:07.686137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:07.687427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:07.687943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:07.688476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:07.710801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:07.721422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:07.723402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:07.725144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 524/1048] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:07.730565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:07.904554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:07.930540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f59c5f3-471f-4065-babe-f28f75f7de92 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:08.005206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:08.006477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:08.006924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:08.007420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:08.008655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:08.009203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:08.011774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:08.029830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 525/1049] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:08.039593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:08.244857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:08.253796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464501df-9544-4b0b-ab4d-e5ffa3d14f33 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:08.328948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:08.330112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:08.330669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:08.331180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] PATH_INFO: `/v3/users/088846d255b54f84b406945b475ae52d` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:08.359490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] RBAC: Authorizing `identity:get_user(user_id=088846d255b54f84b406945b475ae52d)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:08.362285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550c114-5dc7-4f4f-8b55-4e577f48a3ad None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:08.365814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 525/1050] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:08 2022] GET /identity/v3/users/088846d255b54f84b406945b475ae52d => generated 285 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:08.375119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:08.581812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dfcef-7df2-4def-9fab-ca333061f24a None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:08.652414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:08.657256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:08.657256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:08.657256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:08.697681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:08.801780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:08.804581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:08.983737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727541d1-b4c5-4632-b072-c1585e7d37f0 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:08.983993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727541d1-b4c5-4632-b072-c1585e7d37f0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:08.984404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727541d1-b4c5-4632-b072-c1585e7d37f0 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:08.986019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 526/1051] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:08.991705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:08.992074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:08.992379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.013219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:09.014471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:09.035069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 526/1052] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:09.041606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:09.122057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:09.141819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 527/1053] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:09.226722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32368084-6a34-4654-bbf0-316dde440d90 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:09.301033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:09.302144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.302780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.303280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.306602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:09.309299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:09.312863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 527/1054] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:09 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:09.322997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:09.480547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:09.511135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:09.535121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd166d5-5f6e-4864-a82e-cda5e013f09f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:09.595888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:09.596724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.597006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.597280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.598925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=fdccea819ddd472aafe0bf71b8bc551b, user.id=088846d255b54f84b406945b475ae52d) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:09.599242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:09.602301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:09.610051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 528/1055] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:09 2022] GET /identity/v3/role_assignments?user.id=088846d255b54f84b406945b475ae52d&scope.project.id=fdccea819ddd472aafe0bf71b8bc551b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:09.663553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202516c-7b02-41de-9a62-47acd7c4a368 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:09.703515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:09.730530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:09.731198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.731578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.731740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.745876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-9ef9b590-fda0-4455-b8a6-faa4b7ab78f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:09.755588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:09.757199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:09.758077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:09.761581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 528/1056] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:43:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:09.769788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:09.896242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d34b8-8ce0-4a2e-a334-29210fa9df3f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.896441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d34b8-8ce0-4a2e-a334-29210fa9df3f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.896721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d34b8-8ce0-4a2e-a334-29210fa9df3f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.898314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 529/1057] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:09.904583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.904912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.905133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.924461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:09.925681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:09.967578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d393436-cba4-4a82-96fa-1736700b9a83 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.017552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.018172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.018450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.018718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.019473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:10.019784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.021234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.030894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 529/1058] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:43:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:10.037747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.042050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 530/1059] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:10.064016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:10.170307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69dcc8-81a7-4cf8-bc38-e35f958a85b7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.225067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.225791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.226125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.226463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.239551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.241210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:10.259886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:10.261012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:10.261924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:10.261924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:10.261924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:10.266679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 530/1060] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:10.268589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.372960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.425162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeffab-6c18-4b8d-805e-4c3b2729dbef None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.444797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:10.487741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:10.494179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.495216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.495658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.496129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.497189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:10.497642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.499994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.529292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 531/1061] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:10.531458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.570217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ac8ff-f4f4-4b8e-ad34-0b75d4a6eba1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.629645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.630913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.631387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.631810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] PATH_INFO: `/v3/services/image` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.632603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.634816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:10.647199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:10.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:43:10.649457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:10.656885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 531/1062] 10.222.0.96 () {56 vars in 1105 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/services/image => generated 86 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:10.658580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.726841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07940e-cad0-4786-bd7d-f2bee10cab31 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.793105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.793745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.794041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.794295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.809003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.811900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.827387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88833da8-f530-43fc-88e5-f87a65eb0378 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:43:10.835191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:10.838421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:10.840387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 532/1063] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:10.845227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:10.880726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:10.894920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:10.895280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] RBAC: Adding query filter params (name=image) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:10.902402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:10.907777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 532/1064] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:10.914763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.048159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fabb58-608a-4c91-96cd-9c765fd99475 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.077536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5209-03a5-4d8a-9c2b-49c7e78fcf72 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.115919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.117370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.117836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.118850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.120881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:11.121330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.122145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.122770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.123044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.123312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.123968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] RBAC: Adding query filter params (type=image) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:11.124294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.124455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.125727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.132100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 533/1065] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:11.139568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.172269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 533/1066] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:43:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:11.177647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.213078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:11.282793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47690-0ed3-46fa-a708-107657233fac None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.346980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:11.348709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.349763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.350285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.350777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.352235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.355689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.381097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eaf22b-20ee-461f-ac2a-e729c00eeb31 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.463572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.464717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.465209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.465716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.486647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.489480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.520237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 534/1067] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:43:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:11.521206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:11.523943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:11.526344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:11.526344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:11.526344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:11.526344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 534/1068] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:11.536396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.769441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e09fa9-a888-4457-925d-982fb07b139f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.788252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:11.831272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.832112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.832550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.832949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.834080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:11.834589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.837531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1822e4-7968-496d-af21-ed1902e99e00 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.859419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 535/1069] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:11.868072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.977918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151ab9-a493-4e83-ac3e-fb642956e710 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.979053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151ab9-a493-4e83-ac3e-fb642956e710 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.979773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151ab9-a493-4e83-ac3e-fb642956e710 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.982552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 536/1070] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:11.989329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.989584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.990352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.002394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0eb024-18fb-4ee5-82e8-26b07f660b5f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:12.011538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:12.012845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:12.052469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:12.053145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:12.053339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:12.053600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.061380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:12.062859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:12.065559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:43:12.077792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:12.085961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:12.087761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 535/1071] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:12.090655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:12.124994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 537/1072] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:12.232332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686a17d-7b95-4c53-977d-c5637369579e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:12.276605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:12.277245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:12.277522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:12.277796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.278594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:12.278949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:12.280490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:12.300550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 536/1073] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:43:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:12.304017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:12.414973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:12.437367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:12.443781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6070e96-bba8-4ab7-a8d6-93f232a2df14 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:12.488587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:12.491108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:12.491858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:12.492126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:12.492468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/935b50a2adce43b6b49baf71b72c3dbe` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.495252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=7a92f1d8d2904002b5f48ff217117039, role_id=935b50a2adce43b6b49baf71b72c3dbe)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:12.497098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:12.535756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a667a602-7118-440b-9f0b-662a30b1f686 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:12.577889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:12.578662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:12.578967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:12.579270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.592338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:12.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:12.599218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:12.600269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 537/1074] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:12.605148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:12.622787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 538/1075] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:43:12 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/7a92f1d8d2904002b5f48ff217117039/roles/935b50a2adce43b6b49baf71b72c3dbe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:43:12.761712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de67820-25b8-437e-b45b-5edda41e33e7 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:12.787969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:12.814012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:12.814985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:12.814985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:12.815280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:12.815933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:12.816263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:12.817740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:12.831313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 538/1076] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:12.837915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:12.967319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b608-c6c9-49e0-aa9e-368233bae2af None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:13.021009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:13.021664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:13.021931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:13.022199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] PATH_INFO: `/v3/users/088846d255b54f84b406945b475ae52d` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:13.023409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] RBAC: Authorizing `identity:get_user(user_id=088846d255b54f84b406945b475ae52d)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:13.025448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:13.027452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 539/1077] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:12 2022] GET /identity/v3/users/088846d255b54f84b406945b475ae52d => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:13.034268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:13.166349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622f769-780a-4709-8aaf-0cfbb647ed8c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:13.207627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:13.208310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:13.208590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:13.208861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:13.210205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:13.212620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a15d5c-93e3-405e-a9ab-33bbd3733b24 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:13.214634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 539/1078] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:13 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:13.220516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:13.255888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:13.344549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbb43-c82e-4c05-b8c0-d5bddd8fb1ef None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:13.395982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:13.397510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:13.398215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:13.398934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b/users/088846d255b54f84b406945b475ae52d/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:13.404253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdccea819ddd472aafe0bf71b8bc551b, user_id=088846d255b54f84b406945b475ae52d, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:13.406979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8e1a9-658c-4e5d-a57e-04729ddf975d None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:13.519750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 540/1079] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:43:13 2022] PUT /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b/users/088846d255b54f84b406945b475ae52d/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:43:15.051878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74780-d302-4ea2-80ec-bb067ca1a786 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.052449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74780-d302-4ea2-80ec-bb067ca1a786 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.052449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74780-d302-4ea2-80ec-bb067ca1a786 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.053822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 540/1080] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:15.060140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d18ba-5a5d-4869-95e3-1d59fac8ec95 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.060691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d18ba-5a5d-4869-95e3-1d59fac8ec95 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.060691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d18ba-5a5d-4869-95e3-1d59fac8ec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.081623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a79d18ba-5a5d-4869-95e3-1d59fac8ec95 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:15.082842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a79d18ba-5a5d-4869-95e3-1d59fac8ec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:15.167884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 541/1081] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:15.281782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd97ac-5e2b-4ee7-b0eb-4a709fe6d592 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.282184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd97ac-5e2b-4ee7-b0eb-4a709fe6d592 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.282595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd97ac-5e2b-4ee7-b0eb-4a709fe6d592 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.284093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 541/1082] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:15.293559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.294048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.294529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.324693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:15.326390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:15.347472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:15.418066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 542/1083] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:15.447767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd97ac-5e2b-4ee7-b0eb-4a709fe6d592 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:15.515946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:15.603575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd97ac-5e2b-4ee7-b0eb-4a709fe6d592 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:15.651919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:15.656168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.656168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.656168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.674915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:15.680299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:15.682490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:15.684016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 542/1084] 10.222.0.96 () {56 vars in 1120 bytes} [Thu Sep 8 13:43:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:15.688905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:15.821553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb053f-92c3-4e48-b9d4-30253b57aa06 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:15.866276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:15.866914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.867099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.867375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.868601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:15.868903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:15.870302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:15.880602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 543/1085] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:43:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:15.887309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:15.922568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:15.938245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.068153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70c52-489d-4793-8eaa-3b3fc6a44f9b None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.079776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062b7ef-66c2-469a-b5c0-8ed84d22827e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.093734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.126315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.126982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.127860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.129262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.142002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.143171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.143662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.143816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.144131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.145249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:16.163078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:16.164620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:16.166662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:16.166662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:16.166662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:16.175768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 543/1086] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:16.176612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.274786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.276819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f129b73-3e9d-4aa5-85f4-089432df6a43 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.295628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.326734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f715182-8ca8-4ec5-bd78-c6cc4164e142 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.380002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.380681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.381086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.381452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.382242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:16.382645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.384856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca6aec-5f23-4a8f-a883-ed342b26be1a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.399130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 544/1087] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:16.401206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3941a4-96c1-49e7-b903-30a5284678cc None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.401491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3941a4-96c1-49e7-b903-30a5284678cc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.401764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3941a4-96c1-49e7-b903-30a5284678cc None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.403388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 545/1088] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:16.407362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3941a4-96c1-49e7-b903-30a5284678cc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.429016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 544/1089] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:43:16.430341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.430694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.430957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.446656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.452125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:16.453375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:16.535059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 545/1090] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:16.535926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.601784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3941a4-96c1-49e7-b903-30a5284678cc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.618776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.672850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.673839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.674299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.674789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.688814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.691521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:43:16.716124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:16.717237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:43:16.718283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:16.725960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 546/1091] 10.222.0.96 () {56 vars in 1093 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:16.727533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.741408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c5742-a331-43b6-9238-af91f2dc47da None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.807671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.808584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.809022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.809349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.826103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.828169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:16.849094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:16.850790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:16.852390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:16.852390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:16.852390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:16.852390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 546/1092] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:16.860496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.880643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.904880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbe21a-08f4-4253-b58f-47da38947966 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:16.963971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:16.964510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:16.964883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:16.965160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.965946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:16.966248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:16.967704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:16.986934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 547/1093] 10.222.0.96 () {56 vars in 1133 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:16.987798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.020548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.035670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b333343-8059-4e4c-87dd-aca3980d5284 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.090692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.091731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.092035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.092449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.093257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:17.093613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.095228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.121182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 547/1094] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:17.121182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.143583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1458fd-fd5a-4ca5-ae0f-7f0c9591a346 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.202009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.203108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.203570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.203991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.216962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.224528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:17.234706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:17.236896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:17.238491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:17.243769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 548/1095] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:43:17.251620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.310261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96204ea9-41bc-42e8-a530-808b9ce0937c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.371850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.373220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.373604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.373968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.417873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.427128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0f19d-f7cb-4c0a-8f9e-305400099347 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.485356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.486181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.486558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.487054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.487915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:17.488415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.490315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.504858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 549/1096] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:17.512027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.512745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.513782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.622274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.677604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df145d-2bd4-40ff-9d18-2d4c0cbbf6a1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.677862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 548/1097] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:17.684148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.737817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.738414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.738698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.738979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] PATH_INFO: `/v3/users/088846d255b54f84b406945b475ae52d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.740194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] RBAC: Authorizing `identity:get_user(user_id=088846d255b54f84b406945b475ae52d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.741700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.743452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 550/1098] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/users/088846d255b54f84b406945b475ae52d => generated 285 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:17.749496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.753547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.824692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e929cf3-2501-444c-9a8d-b1741b8359fb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.871249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.872232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.872668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.873108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.886598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.887247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfb863-d1ac-4b6b-bd5d-41a6e96def5e None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.888078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:17.906219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:17.907293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:43:17.908274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:17.908274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:43:17.908274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:17.908274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 549/1099] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:17.913651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:17.923992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.939188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.940284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.940746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.941246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.036954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.039806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.046409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b189346-a411-4444-9348-4739cdd69874 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.048402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:18.099760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.100825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.101302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.101759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.102913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:18.103449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.106083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.127968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 550/1100] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:18.134831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:18.232065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 551/1101] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:18.234066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:18.274344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:18.292989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6027d6-6953-4c86-b3f5-c2acb3bd1a95 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.334867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.335526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.336054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.336587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.344279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.345760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:43:18.358384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:18.360123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:18.361980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 551/1102] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:18.365725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:18.388148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996f9b-9291-45b1-a4b5-2a9905760ae1 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.395726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:18.443370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.444122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.444485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.445203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.446797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.448382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.450441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 552/1103] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:18 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:18.457376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:18.493509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419b090-1461-4627-b9fa-f9eded0aae06 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.544302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.544828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.545102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.545377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.546137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:18.546450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.548030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.571940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 552/1104] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:18.573105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:18.591026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:18.597211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2ce0d-9b05-40fd-8819-ecd1a441cdd5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.635522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.636194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.636508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.636783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.637515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=fdccea819ddd472aafe0bf71b8bc551b, user.id=088846d255b54f84b406945b475ae52d) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:18.637834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.639303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82cac-d318-486a-8af7-63243389c038 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.646004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 553/1105] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:18 2022] GET /identity/v3/role_assignments?user.id=088846d255b54f84b406945b475ae52d&scope.project.id=fdccea819ddd472aafe0bf71b8bc551b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:18.698684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:18.719832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d663b-c82c-4591-8400-166a5cdc5db3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:18.763429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:18.764068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:18.764383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:18.764657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:18.765428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] RBAC: Adding query filter params (role.id=935b50a2adce43b6b49baf71b72c3dbe, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=7a92f1d8d2904002b5f48ff217117039) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:18.765740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:18.767342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a08951-568f-4c6d-847c-d1eb758f1b81 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:18.774520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 553/1106] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:18 2022] GET /identity/v3/role_assignments?user.id=7a92f1d8d2904002b5f48ff217117039&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=935b50a2adce43b6b49baf71b72c3dbe => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:21.087949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef13b-7dd9-41d2-acfb-e157f051f384 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.088789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef13b-7dd9-41d2-acfb-e157f051f384 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.088789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecef13b-7dd9-41d2-acfb-e157f051f384 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.090129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 554/1107] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:21.100161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.100731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.101217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.130916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:21.133000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:21.256432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 554/1108] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:21.529763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecef13b-7dd9-41d2-acfb-e157f051f384 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:21.648223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecef13b-7dd9-41d2-acfb-e157f051f384 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:21.688382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:21.689033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.689312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.689586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.690811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:21.692302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b20b0f-ba43-479b-a042-c511809c5802 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:21.699077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 555/1109] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:21.700572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:21.792059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.820128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fea52-d20d-4f76-985c-7955177a3165 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:21.860149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:21.860948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.861321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.861683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.862449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:21.864022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce11bf9-e928-4ccd-90ad-6700b19773aa None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:22.118637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 555/1110] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:43:21 2022] POST /identity/v3/users => generated 286 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:24.466814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89db91-e701-45eb-b5c9-36895e21e167 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:24.467624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89db91-e701-45eb-b5c9-36895e21e167 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:24.467624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89db91-e701-45eb-b5c9-36895e21e167 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:24.468776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 556/1111] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:24.474964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:24.475506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:24.475621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:24.495770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:24.497035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:24.579012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 556/1112] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:24.861780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89db91-e701-45eb-b5c9-36895e21e167 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:24.894962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:24.990206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89db91-e701-45eb-b5c9-36895e21e167 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:25.037364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:25.038018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:25.038293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:25.038565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] PATH_INFO: `/v3/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:25.040734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] RBAC: Authorizing `identity:get_role(role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:25.042132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:25.043628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 557/1113] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:24 2022] GET /identity/v3/roles/21008fb2299d4f8cba069e6c99468411 => generated 223 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:25.049949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:25.192453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:25.238057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f19ff-1a5f-4773-98ce-5fd7fa06ffe0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:25.279546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:25.280240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:25.280514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:25.280791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] PATH_INFO: `/v3/users/91ad7101a6cc49339fde689a4a6a21e2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:25.299429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] RBAC: Authorizing `identity:get_user(user_id=91ad7101a6cc49339fde689a4a6a21e2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:25.300995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:25.302804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 557/1114] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:25 2022] GET /identity/v3/users/91ad7101a6cc49339fde689a4a6a21e2 => generated 286 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:25.310083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:25.426914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:25.433916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e4145-eb4c-463c-b5a0-b0e7425aa938 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:25.474758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:25.475467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:25.475600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:25.475806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:25.560661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:25.562155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:25.683175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:25.690472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 558/1115] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:43:25.697168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:25.821527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456e196-a107-43b9-9dc3-e9efcf4aec63 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:25.844159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:25.860235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:25.860977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:25.861301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:25.861621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:25.862985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:25.864608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe07d48-8ce5-4da4-b37e-7b7a9f8e2982 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:25.866360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 558/1116] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:25 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:25.873650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:25.986642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829bd1a-e45f-400d-8f92-1426ce61dcdf None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:26.026937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:26.027553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:26.027832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:26.028105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:26.028888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=fdccea819ddd472aafe0bf71b8bc551b, user.id=91ad7101a6cc49339fde689a4a6a21e2) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:26.029198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:26.030692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bb193-0a66-484c-80d9-2228b3a0d97b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:26.037690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 559/1117] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:25 2022] GET /identity/v3/role_assignments?user.id=91ad7101a6cc49339fde689a4a6a21e2&scope.project.id=fdccea819ddd472aafe0bf71b8bc551b&role.id=21008fb2299d4f8cba069e6c99468411 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:28.274192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6345-afdb-4b2a-a1af-3f13502205d1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:28.274795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6345-afdb-4b2a-a1af-3f13502205d1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:28.274795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf6345-afdb-4b2a-a1af-3f13502205d1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:28.276103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 559/1118] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:28.282217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:28.282772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:28.282772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:28.302732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:28.303981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:28.369526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:28.383365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 560/1119] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:28.654136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6345-afdb-4b2a-a1af-3f13502205d1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:28.774272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf6345-afdb-4b2a-a1af-3f13502205d1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:28.815661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:28.816260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:28.816660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:28.816942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] PATH_INFO: `/v3/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:28.818469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] RBAC: Authorizing `identity:get_role(role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:28.819871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:28.821893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 560/1120] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:28 2022] GET /identity/v3/roles/21008fb2299d4f8cba069e6c99468411 => generated 223 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:28.828180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:28.944332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252057df-3e7a-431c-94f4-d2f15a790615 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:28.983580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:28.984270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:28.984552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:28.984826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] PATH_INFO: `/v3/users/91ad7101a6cc49339fde689a4a6a21e2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:28.986084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] RBAC: Authorizing `identity:get_user(user_id=91ad7101a6cc49339fde689a4a6a21e2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:28.987578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:28.989336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 561/1121] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:28 2022] GET /identity/v3/users/91ad7101a6cc49339fde689a4a6a21e2 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:28.996294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:29.065256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:29.115036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0efc8-5a2b-44b8-b1e2-151a3cf80c9e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:29.154240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:29.154888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:29.155170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:29.155447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:29.156746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:29.158221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b72006-7cc2-4519-ada4-21b94790c4d1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:29.159950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 561/1122] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:28 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:29.167959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:29.234441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:29.279816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e31f9-95c8-43fb-9617-4e68ce6200d5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:29.322561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:29.323269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:29.323515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:29.323793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b/users/91ad7101a6cc49339fde689a4a6a21e2/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:29.326114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdccea819ddd472aafe0bf71b8bc551b, user_id=91ad7101a6cc49339fde689a4a6a21e2, role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:29.327577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdaea7e-e734-47a9-ab65-1a00fb916f88 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:29.455860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 562/1123] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:43:29 2022] PUT /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b/users/91ad7101a6cc49339fde689a4a6a21e2/roles/21008fb2299d4f8cba069e6c99468411 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:43:31.720176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff194-b47d-4a2e-b2b0-ddcd112019d3 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:31.720833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff194-b47d-4a2e-b2b0-ddcd112019d3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:31.720833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff194-b47d-4a2e-b2b0-ddcd112019d3 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:31.722137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 562/1124] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:31.729134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:31.729988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:31.730152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:31.750511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:31.751776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:31.834188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 563/1125] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:32.119512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff194-b47d-4a2e-b2b0-ddcd112019d3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:32.252789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff194-b47d-4a2e-b2b0-ddcd112019d3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:32.283378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:32.299343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:32.300478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:32.300925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:32.301357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] PATH_INFO: `/v3/roles/21008fb2299d4f8cba069e6c99468411` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:32.304014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] RBAC: Authorizing `identity:get_role(role_id=21008fb2299d4f8cba069e6c99468411)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:32.306575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:32.309026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 563/1126] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:32 2022] GET /identity/v3/roles/21008fb2299d4f8cba069e6c99468411 => generated 223 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:32.316802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:32.391756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:32.457687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafda20a-0f5b-48db-83c3-55619493ce69 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:32.505751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:32.506415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:32.506694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:32.506968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] PATH_INFO: `/v3/users/91ad7101a6cc49339fde689a4a6a21e2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:32.508945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=91ad7101a6cc49339fde689a4a6a21e2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:32.510485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:32.512379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 564/1127] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:32 2022] GET /identity/v3/users/91ad7101a6cc49339fde689a4a6a21e2 => generated 286 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:32.519098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:32.639038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d942-c5b5-4747-a89c-fe944d624c21 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:32.678711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:32.679233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:32.680040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:32.680505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:32.747901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:32.759373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:32.771831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:32.880897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 564/1128] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:32.887996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:33.008113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d1ceb-4aab-42b5-8e23-45167d875ba6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:33.027880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:33.048370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:33.049094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:33.049422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:33.049746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] PATH_INFO: `/v3/projects/fdccea819ddd472aafe0bf71b8bc551b` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:33.051125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] RBAC: Authorizing `identity:get_project(project_id=fdccea819ddd472aafe0bf71b8bc551b)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:33.052734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f84a60-6326-468e-97e9-54141044df57 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:33.055255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 565/1129] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:32 2022] GET /identity/v3/projects/fdccea819ddd472aafe0bf71b8bc551b => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:33.062179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:33.167729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:33.179065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff175-e886-47db-b85d-5aa9d24df1c9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:33.221763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:33.222395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:33.222673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:33.222943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:33.223717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] RBAC: Adding query filter params (role.id=21008fb2299d4f8cba069e6c99468411, scope.project.id=fdccea819ddd472aafe0bf71b8bc551b, user.id=91ad7101a6cc49339fde689a4a6a21e2) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:33.224103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:33.225652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba47c8-5f65-4f6c-b4d0-3abc95e24720 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:33.234334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 565/1130] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:33 2022] GET /identity/v3/role_assignments?user.id=91ad7101a6cc49339fde689a4a6a21e2&scope.project.id=fdccea819ddd472aafe0bf71b8bc551b&role.id=21008fb2299d4f8cba069e6c99468411 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:35.524599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb080a-74ed-4b32-a659-2b72563c74f9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:35.525176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb080a-74ed-4b32-a659-2b72563c74f9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:35.525176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb080a-74ed-4b32-a659-2b72563c74f9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:35.526587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 566/1131] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:35.532921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:35.533496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:35.533496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:35.553999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:35.555781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:35.634851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 566/1132] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:35.949672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb080a-74ed-4b32-a659-2b72563c74f9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:36.072011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb080a-74ed-4b32-a659-2b72563c74f9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:36.111028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:36.111676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:36.111956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:36.112256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:36.113455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:36.114932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36352d-bd78-4e2b-921a-849d541d651a None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:36.116690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 567/1133] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:36.123367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:36.225417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:36.243249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802ec8-683e-44ef-bc0d-21de7ff33b69 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:36.286002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:36.286635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:36.286949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:36.287228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:36.287916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:36.289459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96633fc-24e5-427b-953e-2046e5c0f336 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:36.405771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 567/1134] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:43:36 2022] POST /identity/v3/projects => generated 311 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:43:38.726102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f45a-e5dd-4cce-b03d-37c7baef769c None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:38.727494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f45a-e5dd-4cce-b03d-37c7baef769c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:38.727494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102f45a-e5dd-4cce-b03d-37c7baef769c None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:38.728777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 568/1135] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:38.734887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:38.735491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:38.735491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:38.755704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:38.757050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:38.836794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 568/1136] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:39.113445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102f45a-e5dd-4cce-b03d-37c7baef769c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:39.176172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:39.228951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102f45a-e5dd-4cce-b03d-37c7baef769c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:39.269769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:39.270419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:39.270704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:39.270981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:39.272174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:39.274254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135fcaf-3a04-4b26-a3a3-e700d70b8d85 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:39.275937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 569/1137] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:43:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:39.282172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:39.362441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:39.397253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ab68a-ad63-4024-83bd-9e32b6e8bd6b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:39.456970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:39.457863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:39.458274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:39.458677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:39.459692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:39.462594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9d7b5-fca7-48f0-a244-ef479cc3bc38 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:39.598130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 569/1138] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:43:39 2022] POST /identity/v3/users => generated 286 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:43:42.007623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7fb1-40ac-4c39-9bd6-add5640f869c None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:42.008231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7fb1-40ac-4c39-9bd6-add5640f869c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:42.008231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f7fb1-40ac-4c39-9bd6-add5640f869c None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:42.009603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 570/1139] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:42.016508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:42.017337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:42.017337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:42.083197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:42.084485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:42.160452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 570/1140] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:42.441346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f7fb1-40ac-4c39-9bd6-add5640f869c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:42.567791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f7fb1-40ac-4c39-9bd6-add5640f869c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:42.596419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:42.613361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:42.614023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:42.614305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:42.614586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:42.626818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:42.631920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:42.633592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:42.634524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 571/1141] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:42.640814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:42.708286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:42.761916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb078-794c-42ff-b3c2-0835423a237c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:42.803575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:42.804260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:42.804547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:42.804822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:42.805523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:42.805831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:42.807273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:42.816962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 571/1142] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:42.826929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:42.943455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b087cc3-46f4-4c95-833e-f185f1d65b83 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:42.984478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:42.985087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:42.985324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:42.985604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] PATH_INFO: `/v3/users/7a59d56d61a946d7b84867ccd89a7dc2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:43.003387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a59d56d61a946d7b84867ccd89a7dc2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:43.004952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:43.006755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 572/1143] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:42 2022] GET /identity/v3/users/7a59d56d61a946d7b84867ccd89a7dc2 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:43.017046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:43.180435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ed64c-3186-402d-b0a2-62a5d9869382 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:43.199638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:43.221085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:43.222133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:43.222607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:43.223075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:43.326285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:43.327888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:43.450102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 572/1144] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:43.456730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:43.507502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:43.579516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9738454-4f8e-4887-b682-26c8c7d7a1c0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:43.619861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:43.620551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:43.620831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:43.621107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] PATH_INFO: `/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:43.622334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] RBAC: Authorizing `identity:get_project(project_id=0d9e21223d8f4fc3ad1a3f7a53c6ca22)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:43.623791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bba72-d6e6-46bc-8cdb-afb5c94bbfe6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:43.625561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 573/1145] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:43 2022] GET /identity/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:43.632704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:43.654140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:43.748865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f925c-8aa5-4226-b3e8-848325f2ef5f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:43.789020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:43.789749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:43.790032 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:43.790307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:43.791065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=0d9e21223d8f4fc3ad1a3f7a53c6ca22, user.id=7a59d56d61a946d7b84867ccd89a7dc2) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:43.791375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:43.792946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a441-3df2-4cf2-bbdb-fb684bcca042 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:43.799663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 573/1146] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:43 2022] GET /identity/v3/role_assignments?user.id=7a59d56d61a946d7b84867ccd89a7dc2&scope.project.id=0d9e21223d8f4fc3ad1a3f7a53c6ca22&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:46.984858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2706c-6946-4fef-9b1c-76c46b853c97 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:46.985416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2706c-6946-4fef-9b1c-76c46b853c97 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:46.985416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2706c-6946-4fef-9b1c-76c46b853c97 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:46.986658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 574/1147] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:46.993232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:46.994096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:46.994096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.014738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:47.015969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:47.093805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 574/1148] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:43:47.374176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2706c-6946-4fef-9b1c-76c46b853c97 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:47.496484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2706c-6946-4fef-9b1c-76c46b853c97 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:47.505530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:47.535358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:47.536009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:47.536319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:47.536587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.549314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:47.554934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:47.556955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:47.558575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 575/1149] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:47.562832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:47.577006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:47.679260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce539b8-556e-46ed-9706-ae4b29781bc3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:47.719429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:47.720040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:47.720348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:47.720615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.721341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:47.721656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:47.723038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:47.733413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 575/1150] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:47.739760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:47.860488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022c51c-7bd0-4929-b814-4a218009e3e6 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:47.902005 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:47.902800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:47.903135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:47.903504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] PATH_INFO: `/v3/users/7a59d56d61a946d7b84867ccd89a7dc2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.904929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] RBAC: Authorizing `identity:get_user(user_id=7a59d56d61a946d7b84867ccd89a7dc2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:47.906525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:47.908633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 576/1151] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:47 2022] GET /identity/v3/users/7a59d56d61a946d7b84867ccd89a7dc2 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:47.915720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:48.002568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:48.036894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15854d0-85ab-4490-8121-6c1e6ba9cb03 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:48.076680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:48.077473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:48.077804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:48.078137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] PATH_INFO: `/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:48.079495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] RBAC: Authorizing `identity:get_project(project_id=0d9e21223d8f4fc3ad1a3f7a53c6ca22)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:48.081076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feb7c6-490b-480d-a01e-74bd9957fd33 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:48.082960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 576/1152] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:47 2022] GET /identity/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:48.090461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:48.129955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:48.206244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0f10d-3c58-41d8-bd05-9bfd0f9cc26b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:48.246305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:48.246991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:48.247276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:48.247556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] PATH_INFO: `/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22/users/7a59d56d61a946d7b84867ccd89a7dc2/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:48.249639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d9e21223d8f4fc3ad1a3f7a53c6ca22, user_id=7a59d56d61a946d7b84867ccd89a7dc2, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:48.251136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9f35c-3e71-4e8e-8f15-743d44aeb19f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:48.341396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 577/1153] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:43:48 2022] PUT /identity/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22/users/7a59d56d61a946d7b84867ccd89a7dc2/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:43:50.604593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b10f5-1b6a-4348-bd3b-87a32f059008 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:50.605163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b10f5-1b6a-4348-bd3b-87a32f059008 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:50.605163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b10f5-1b6a-4348-bd3b-87a32f059008 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:50.606467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 577/1154] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:50.612528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:50.613088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:50.613088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:50.633972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:50.635234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:50.715241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 578/1155] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:50.993313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b10f5-1b6a-4348-bd3b-87a32f059008 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:51.111746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b10f5-1b6a-4348-bd3b-87a32f059008 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:51.153075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:51.153741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.154024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.154302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.163501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.167697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:43:51.172919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:51.177660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:43:51.178529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 578/1156] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:51.181404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:51.222500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.311907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4fd20-2d8b-4fea-919c-9dc59f2a5112 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:51.352789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:51.353473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.353791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.354102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.354870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:51.355312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:51.356824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:51.367753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 579/1157] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:51.374262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:51.495106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a250cd-aaa0-4514-92d0-7efdc3d3ad22 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:51.540168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:51.540916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.541240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.541559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] PATH_INFO: `/v3/users/7a59d56d61a946d7b84867ccd89a7dc2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.542872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] RBAC: Authorizing `identity:get_user(user_id=7a59d56d61a946d7b84867ccd89a7dc2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:51.544606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:51.546408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 579/1158] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:43:51 2022] GET /identity/v3/users/7a59d56d61a946d7b84867ccd89a7dc2 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:51.556333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:51.713636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.734747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1eaab-f336-49bc-b59f-7b6ff6296698 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:51.772992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:51.773652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.773998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.774311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.851997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:51.853409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:51.952115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.969566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 580/1159] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:43:51.976793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:52.055229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:52.093355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791854d1-e06b-4623-abd7-d392b26aa0ff None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:52.131154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:52.131823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:52.132141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:52.132510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] PATH_INFO: `/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:52.133743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] RBAC: Authorizing `identity:get_project(project_id=0d9e21223d8f4fc3ad1a3f7a53c6ca22)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:52.135256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72159208-390f-4a9e-a0ee-75560f0af852 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:52.137012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 580/1160] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:43:51 2022] GET /identity/v3/projects/0d9e21223d8f4fc3ad1a3f7a53c6ca22 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:43:52.143742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:52.256806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a54c7-fafd-49f4-a116-9bddd5b05147 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:52.296641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:52.297255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:52.297530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:52.297828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:52.298561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=0d9e21223d8f4fc3ad1a3f7a53c6ca22, user.id=7a59d56d61a946d7b84867ccd89a7dc2) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:52.298859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:52.300363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85733582-5c89-44ff-85fa-fe990cb31f2b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:52.307422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 581/1161] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:43:52 2022] GET /identity/v3/role_assignments?user.id=7a59d56d61a946d7b84867ccd89a7dc2&scope.project.id=0d9e21223d8f4fc3ad1a3f7a53c6ca22&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:54.615805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaffe-420d-4f2d-81b2-aec830b42ea5 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:54.616469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaffe-420d-4f2d-81b2-aec830b42ea5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:54.616469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecaffe-420d-4f2d-81b2-aec830b42ea5 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:54.617791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 581/1162] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:54.624014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:54.624660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:54.624660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:54.644781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:54.646020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:54.702544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:54.725908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 582/1163] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:55.009144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecaffe-420d-4f2d-81b2-aec830b42ea5 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:55.129985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecaffe-420d-4f2d-81b2-aec830b42ea5 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:55.169058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:55.169676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:55.169952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:55.170227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:55.174285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:55.249824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:55.251314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:55.376376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 582/1164] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:43:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:55.383322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:55.571136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14832d-7c75-4180-afaa-500343247e20 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:55.622941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:55.623590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:55.623870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:55.624140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:55.633147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:55.634535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-aa5cbe5f-78e0-4fae-90f8-8ba12f760346 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:43:55.648690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:43:55.650689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:43:55.652380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 583/1165] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:43:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:43:55.656434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:55.695159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:55.768471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837c0e-e7e2-4f15-acf9-d7c698d469bc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:55.809448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:55.810060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:55.810332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:55.810602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:55.811374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:43:55.811675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:55.813111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7796-0aff-475c-9aac-d1f433849093 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:55.821512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 583/1166] 10.222.0.96 () {56 vars in 1115 bytes} [Thu Sep 8 13:43:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:43:58.120732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b928-923e-4c11-9b92-11563141808b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:58.121607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b928-923e-4c11-9b92-11563141808b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:58.121607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6b928-923e-4c11-9b92-11563141808b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:58.123349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 584/1167] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:58.134109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1d69-d1bc-41cb-af39-dd0c168a002a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:58.134654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1d69-d1bc-41cb-af39-dd0c168a002a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:58.135092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af1d69-d1bc-41cb-af39-dd0c168a002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:58.165962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-26af1d69-d1bc-41cb-af39-dd0c168a002a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:58.167955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-26af1d69-d1bc-41cb-af39-dd0c168a002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:58.291003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 584/1168] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:43:58.565231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b928-923e-4c11-9b92-11563141808b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:58.616481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:58.685832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6b928-923e-4c11-9b92-11563141808b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:58.726767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:58.727450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:58.727773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:58.728092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:58.728854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:58.730293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb5933-318f-4599-aaeb-1e0741d665d5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:58.850061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 585/1169] 10.222.0.96 () {60 vars in 1138 bytes} [Thu Sep 8 13:43:58 2022] POST /identity/v3/domains => generated 267 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:44:01.628383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e37d-09a2-4d04-a7e1-21d34838df85 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:01.629295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e37d-09a2-4d04-a7e1-21d34838df85 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:01.629295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637e37d-09a2-4d04-a7e1-21d34838df85 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:01.630950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 585/1170] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:01.640453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:01.641092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:01.641446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:01.673380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:01.675660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:01.802184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 586/1171] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:44:02.311841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e37d-09a2-4d04-a7e1-21d34838df85 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:02.347398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:02.430603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637e37d-09a2-4d04-a7e1-21d34838df85 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:02.470100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:02.470758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:02.471041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:02.471320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] PATH_INFO: `/v3/domains/4e33df3c5003463e8576c42aea1c8ce2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:02.483974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e33df3c5003463e8576c42aea1c8ce2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:02.485494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c08b6-1d5f-4494-9424-f78087dcfea2 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:02.487324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 586/1172] 10.222.0.96 () {56 vars in 1183 bytes} [Thu Sep 8 13:44:02 2022] GET /identity/v3/domains/4e33df3c5003463e8576c42aea1c8ce2 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:02.494521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:02.529104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:02.613527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18813-c3af-40ca-afc3-a8fd6d84d12a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:02.654401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:02.655267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:02.655413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:02.655857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:02.657088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:02.659739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec16450-a06c-4248-83c7-e8e9fcfd0da3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:02.765361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 587/1173] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:44:02 2022] POST /identity/v3/projects => generated 361 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:44:05.096049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622a4a7-e960-47b9-8a11-424239c440cd None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:05.097096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622a4a7-e960-47b9-8a11-424239c440cd None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:05.097096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622a4a7-e960-47b9-8a11-424239c440cd None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:05.097995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 587/1174] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:05.103737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:05.104322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:05.104322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:05.124387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:05.125759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:05.207619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 588/1175] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:44:05.479891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622a4a7-e960-47b9-8a11-424239c440cd None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:05.605573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:05.617215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622a4a7-e960-47b9-8a11-424239c440cd None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:05.659014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:05.659659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:05.659938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:05.660236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] PATH_INFO: `/v3/domains/4e33df3c5003463e8576c42aea1c8ce2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:05.661447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4e33df3c5003463e8576c42aea1c8ce2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:05.663605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ea1f2-8bef-4aef-bc0c-07d2748fd0b3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:05.665457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 588/1176] 10.222.0.96 () {56 vars in 1183 bytes} [Thu Sep 8 13:44:05 2022] GET /identity/v3/domains/4e33df3c5003463e8576c42aea1c8ce2 => generated 267 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:05.672219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:05.699028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:05.868082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5930b5-e7f8-418e-b5d5-ecc2753d8f6c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:05.932079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:05.933175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:05.933688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:05.934188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:05.935355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:05.938060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b57b01-fca5-443f-acbe-dc78932d0536 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:06.037766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 589/1177] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:44:05 2022] POST /identity/v3/users => generated 311 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:44:08.382354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c110-fe36-4c39-8300-69f2ea6f1a7b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:08.382971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c110-fe36-4c39-8300-69f2ea6f1a7b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:08.382971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0c110-fe36-4c39-8300-69f2ea6f1a7b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:08.384595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 589/1178] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:08.393718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:08.394341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:08.394341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:08.414513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:08.415755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:08.486624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:08.492750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 590/1179] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:44:08.859450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c110-fe36-4c39-8300-69f2ea6f1a7b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:09.018372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0c110-fe36-4c39-8300-69f2ea6f1a7b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:09.067371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:09.069789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:09.069789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:09.069789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:09.081400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:09.087564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:09.094638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:44:09.096282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 590/1180] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:44:09.099235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:09.255944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2bb20-ac70-4427-b534-381550f1e66d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:09.306034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:09.306654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:09.306936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:09.307207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:09.307881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:09.308185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:09.309665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:09.319872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 591/1181] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:09.327649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:09.360772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:09.482802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f93b7-5086-45b5-aff7-4bffc62d9834 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:09.527614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:09.528367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:09.528746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:09.529108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] PATH_INFO: `/v3/users/0f06ab008723426486620c117cd02f2a` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:09.545768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] RBAC: Authorizing `identity:get_user(user_id=0f06ab008723426486620c117cd02f2a)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:09.547386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:09.549344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 591/1182] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:09 2022] GET /identity/v3/users/0f06ab008723426486620c117cd02f2a => generated 311 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:09.559136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:09.658202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:09.724756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b452478-e2d5-43d4-a4eb-fb014b484e61 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:09.788509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:09.789053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:09.789337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:09.789608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:09.874785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:09.876315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:09.946225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:09.999543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 592/1183] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:44:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:44:10.010571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:10.136236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:10.161513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68403d-fb74-4ca0-9890-de21d445d534 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:10.222267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:10.223161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:10.223547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:10.223929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] PATH_INFO: `/v3/projects/4cbb8605abb34d27a3beac15f55df153` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:10.225769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] RBAC: Authorizing `identity:get_project(project_id=4cbb8605abb34d27a3beac15f55df153)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:10.227944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff9fb8-49b1-49c1-bcd9-0b67b7b94f49 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:10.230536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 592/1184] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:44:10 2022] GET /identity/v3/projects/4cbb8605abb34d27a3beac15f55df153 => generated 361 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:10.237500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:10.357294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9231baf-7935-498f-afb4-774281887e7b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:10.397664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:10.398239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:10.398567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:10.398890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:10.399692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=4cbb8605abb34d27a3beac15f55df153, user.id=0f06ab008723426486620c117cd02f2a) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:10.400093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:10.401711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56d744-7b28-4334-9c14-76d8cee72686 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:10.408424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 593/1185] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:44:10 2022] GET /identity/v3/role_assignments?user.id=0f06ab008723426486620c117cd02f2a&scope.project.id=4cbb8605abb34d27a3beac15f55df153&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:12.683851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea6d9-654b-44c8-ab91-71a3e1e65680 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:12.684491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea6d9-654b-44c8-ab91-71a3e1e65680 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:12.684491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ea6d9-654b-44c8-ab91-71a3e1e65680 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:12.685922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 593/1186] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:12.692263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:12.692815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:12.692980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:12.713119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:12.714375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:12.736404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:12.795529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 594/1187] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:44:13.072995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea6d9-654b-44c8-ab91-71a3e1e65680 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:13.191522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ea6d9-654b-44c8-ab91-71a3e1e65680 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:13.232245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:13.232889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.233167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.233436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.245897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:13.250909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:13.252760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:44:13.254337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 594/1188] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:44:13.261901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:13.435544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25341b3b-7cb2-4414-98e5-e62319e3f326 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:13.475751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:13.476398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.476678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.476979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.477668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:13.477972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:13.479365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:13.488912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 595/1189] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:13.499059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:13.504556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:13.615488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e79d3-adf1-4637-9f0b-0e595380cbcb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:13.654666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:13.655307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.655584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.655855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] PATH_INFO: `/v3/users/0f06ab008723426486620c117cd02f2a` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.657140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f06ab008723426486620c117cd02f2a)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:13.658738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:13.660458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 595/1190] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:13 2022] GET /identity/v3/users/0f06ab008723426486620c117cd02f2a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:13.671328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:13.694969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:13.789925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cc31-000a-4385-8ff5-a1a16d174b79 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:13.826860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:13.827504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.827785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.828060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] PATH_INFO: `/v3/projects/4cbb8605abb34d27a3beac15f55df153` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.829299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] RBAC: Authorizing `identity:get_project(project_id=4cbb8605abb34d27a3beac15f55df153)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:13.830771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8487-693b-439c-85a8-989c75eaf633 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:13.832547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 596/1191] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:44:13 2022] GET /identity/v3/projects/4cbb8605abb34d27a3beac15f55df153 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:13.839931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:13.918514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:13.952776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a660-4320-4a74-ad62-9081518229e8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:13.992510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:13.993191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.993474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.993782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] PATH_INFO: `/v3/projects/4cbb8605abb34d27a3beac15f55df153/users/0f06ab008723426486620c117cd02f2a/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.995805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] RBAC: Authorizing `identity:create_grant(project_id=4cbb8605abb34d27a3beac15f55df153, user_id=0f06ab008723426486620c117cd02f2a, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:13.997310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e01fc-965a-4bf8-a1e5-c9adba0ffd10 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:14.072337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 596/1192] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:44:13 2022] PUT /identity/v3/projects/4cbb8605abb34d27a3beac15f55df153/users/0f06ab008723426486620c117cd02f2a/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:44:16.336229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60f78-8028-48d4-9ce9-99f54acf8e56 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:16.337023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60f78-8028-48d4-9ce9-99f54acf8e56 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:16.337023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60f78-8028-48d4-9ce9-99f54acf8e56 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:16.338329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 597/1193] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:16.344643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:16.345191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:16.345191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:16.365125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:16.366849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:16.447618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 597/1194] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:44:16.733375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60f78-8028-48d4-9ce9-99f54acf8e56 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:16.828191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:16.847157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60f78-8028-48d4-9ce9-99f54acf8e56 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:16.886545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:16.887182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:16.887458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:16.887735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:16.899717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:44:16.904707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:44:16.906494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:44:16.908118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 598/1195] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:44:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:44:16.912930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:16.981352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:17.024126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d8f29f-1461-4991-8a11-12ba9387dcfc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:17.063835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:17.064515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:17.064794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:17.065066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:17.065776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:17.066073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:17.067484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:17.077295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 598/1196] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:44:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:17.083765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:17.202619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc72a5-c1b7-4e35-847f-e811b6d8c4cc None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:17.242063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:17.242713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:17.242995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:17.243271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] PATH_INFO: `/v3/users/0f06ab008723426486620c117cd02f2a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:17.244541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] RBAC: Authorizing `identity:get_user(user_id=0f06ab008723426486620c117cd02f2a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:17.246021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:17.247852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 599/1197] 10.222.0.96 () {56 vars in 1177 bytes} [Thu Sep 8 13:44:17 2022] GET /identity/v3/users/0f06ab008723426486620c117cd02f2a => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:17.254283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:17.371820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ea1b1-2b23-4759-ba15-51a22a0a75e5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:17.399383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:17.410467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:17.411081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:17.411360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:17.411631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:17.487691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:17.489260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:17.606589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 599/1198] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:44:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:44:17.613136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:17.630563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:17.737755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52995-28a9-4469-a1ce-1da68fd401ad None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:17.777858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:17.778937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:17.779411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:17.779871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] PATH_INFO: `/v3/projects/4cbb8605abb34d27a3beac15f55df153` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:17.781418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] RBAC: Authorizing `identity:get_project(project_id=4cbb8605abb34d27a3beac15f55df153)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:17.783578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc9033-5937-4094-8edd-e9294070b274 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:17.785512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 600/1199] 10.222.0.96 () {56 vars in 1186 bytes} [Thu Sep 8 13:44:17 2022] GET /identity/v3/projects/4cbb8605abb34d27a3beac15f55df153 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:44:17.793051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:17.822055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:17.908881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e8431-0d0f-4176-9688-efd794da92a5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:17.948525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:17.949150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:17.949435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:17.949702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:17.950442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=4cbb8605abb34d27a3beac15f55df153, user.id=0f06ab008723426486620c117cd02f2a) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:44:17.950752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:17.952323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5328ca4-c59b-4f57-9fe1-56f3243c8369 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:17.959776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 600/1200] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:44:17 2022] GET /identity/v3/role_assignments?user.id=0f06ab008723426486620c117cd02f2a&scope.project.id=4cbb8605abb34d27a3beac15f55df153&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:44:27.771607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=60 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:27.956336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=56 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:45.210147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e538a1-92f9-494d-a475-21d34147e27e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.210811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e538a1-92f9-494d-a475-21d34147e27e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.210811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e538a1-92f9-494d-a475-21d34147e27e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.212055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 601/1201] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:45.218251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.218838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.218838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.238226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:45.239461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:45.317001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 601/1202] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:45:45.596655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e538a1-92f9-494d-a475-21d34147e27e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.720839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e538a1-92f9-494d-a475-21d34147e27e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:45.763288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:45.764069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:45.764480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:45.764854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:45.779688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:45.783998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:45:45.798685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:45.800759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:45:45.803534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:45:45.803534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:45.803534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:45:45.803534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 602/1203] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:45.808550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:45.955451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3fd35-1b4f-48c6-9768-b1810e1af3c7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:46.001352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:46.008149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:46.008877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:46.009200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:46.009531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:46.010262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:46.010614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:46.012074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd55f-d716-4a60-a82e-4fa37a0c6d52 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:46.025879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 602/1204] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:46.032336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:46.094963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:46.163824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2ef72-784c-448d-8ae4-832c7ca4cb54 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:46.241912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:46.242865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:46.243346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:46.243817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:46.245077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:46.247935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada6619-27bd-488a-b8f4-405300893152 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:46.347795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 603/1205] 10.222.0.96 () {60 vars in 1132 bytes} [Thu Sep 8 13:45:46 2022] POST /identity/v3/users => generated 251 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:45:48.759783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8febd5-3ee8-46f0-bf88-cc57c191f3b0 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.760492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8febd5-3ee8-46f0-bf88-cc57c191f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.760492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8febd5-3ee8-46f0-bf88-cc57c191f3b0 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.761763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 603/1206] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:48.768120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:48.768970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:48.768970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:48.789037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:48.790270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:48.879448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 604/1207] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:45:49.167668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8febd5-3ee8-46f0-bf88-cc57c191f3b0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.285071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8febd5-3ee8-46f0-bf88-cc57c191f3b0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.323818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.324500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.324779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.325050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.337694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:49.343286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:49.345179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:49.346954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 604/1208] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:49.351113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.402018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.474988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdbb40-c47d-406a-bd50-2ae5da29bf21 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.516085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.517330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.518092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.518610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.519869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:49.520603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.524737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.541498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 605/1209] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:49.547818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.611379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.674894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f50787-184c-4be0-9bdd-16440e5ad497 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.713574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.714504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.714785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.715120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.728338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.729936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:45:49.748425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:49.750245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:45:49.752078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:45:49.752078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:49.752078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:49.752078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 605/1210] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:49.757076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:49.876171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.879655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a0a02-a79b-46ee-8578-e30fe68f6473 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:49.919054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:49.919834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:49.920238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:49.920605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:49.921352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:49.921749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:49.923324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:49.937730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 606/1211] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:45:49.944129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.064645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77a97-4657-4039-a185-c7ee166f92e5 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.066514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.104568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.105290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.105620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.105930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.115270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.117037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:45:50.130383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:50.132837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:50.134439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 606/1212] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:50.139261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.267902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdc973-d487-4806-a17f-fa25d284fbff None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.309360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.310435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.310930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.311418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.312824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:50.313377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.316082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.345041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 607/1213] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:50.352185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.463490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678cacc-e72e-42e3-b094-84588b6ccc95 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.502011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.502630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.502906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.503177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.536969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.580930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.582375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.704993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 607/1214] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:50.711116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.735482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:50.826895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b91af1-ac7b-4a0c-802f-42fc129a91aa None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:50.867599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:50.868166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:50.868475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:50.868745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:50.882326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:50.884968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:45:50.901495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:50.908752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:45:50.910746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:45:50.910746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:50.910746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:45:50.910746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 608/1215] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:50.911303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:50.986562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.038207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93e5f-f1f7-4678-90e2-76ad3a0246b9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.084164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.084914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.085354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.085744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.086603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.087163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.088872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.104876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 608/1216] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:51.111450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.192182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.231625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af185f2-06b2-4541-828d-fa3bb64ece16 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.269941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.270692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.270978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.271254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.279452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.280937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:45:51.293724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:51.295374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:45:51.297179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 609/1217] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:51.302408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.418351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4bb6a-50c1-4729-a5a9-c081aa7717ec None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.442068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.454067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.454601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.454878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.455148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.455845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.456149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.457606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc596c90-6669-4dac-acc4-02361e0a6caf None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.471385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 609/1218] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:51.481878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:51.630547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84e4f9-80c2-49a9-abba-74a67b623917 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:51.668675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:51.675063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:51.675727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:51.676115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:51.676419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:51.677311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=1a34d9681ab04766a822de8737a227e0) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:51.677836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:51.679359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1536c3c-6227-42ad-9f4e-6cce56caceba None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:51.685843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 610/1219] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:45:51 2022] GET /identity/v3/role_assignments?user.id=1a34d9681ab04766a822de8737a227e0&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:53.991026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93674-907f-4234-873e-3eba084409e3 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.991545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93674-907f-4234-873e-3eba084409e3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.991545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93674-907f-4234-873e-3eba084409e3 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:53.992891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 610/1220] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:53.998980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:53.999564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:53.999564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.024387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:54.033503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:54.106957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 611/1221] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:45:54.384192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93674-907f-4234-873e-3eba084409e3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.500346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93674-907f-4234-873e-3eba084409e3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.544732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.545799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.546281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.546806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.563886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:54.569709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:54.571460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:54.573176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 611/1222] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:54.580429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.698346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a3047-6d26-4d5e-ba5a-20b619ff31fe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.726985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:54.738907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.739560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.739838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.740109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.741382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] RBAC: Adding query filter params (name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:54.741685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:54.743077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:54.752459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 612/1223] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:54.761361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:54.815443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:54.883653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e65c9-c6d8-4dad-ab16-0cb70857f4bb None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:54.932120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:54.932806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:54.933176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:54.933362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:54.952448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:54.954468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:45:54.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:54.985634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:45:54.986540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:45:54.986540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:54.986540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:54.986540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 612/1224] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:54.993920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.114716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161149b3-1dba-41ca-a5eb-f86a6f400f5b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.155754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.156431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.156709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.156984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.157645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:55.157981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.159385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.174143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 613/1225] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:55.181117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.304304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.312659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b4d24-41bc-4cd5-8c09-906a99c077af None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.352499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.353186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.353466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.353739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.363229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.364991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:45:55.377640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:55.379631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:55.385866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 613/1226] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:55.386658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.463422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:55.562049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cca3b8-454b-4acc-a60f-59470d518e21 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.615272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.615917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.616197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.616500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.617230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:55.617531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.619098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.638599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 614/1227] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:55.645335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.757010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45771673-c53d-4879-b782-f35c6cbad92c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.795324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:55.795962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:55.796264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:55.796539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:55.808465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:55.809975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:45:55.826543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:55.827746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:45:55.828903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:45:55.828903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:45:55.828903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:55.828903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 614/1228] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:55.837722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:55.968158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427fa87-9112-4c56-8ac7-2ee330de74e0 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:55.970810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:56.006955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.007577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.008046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.013401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.013401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:56.013401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:56.013401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.023988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 615/1229] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:56.030101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.043183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:56.148943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d3aa4-e42e-4806-8193-1d1215f16a33 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.186527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.187187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.187435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.187739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.196629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:56.202531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:45:56.210952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:56.212712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:45:56.214735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 615/1230] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:45:56.219233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.352676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9e78a-bfba-4ad9-b407-7b59b7978852 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.416177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.417143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.417627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.418156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.419442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:56.419990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:56.422712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d679b-f0fa-4fcf-94e7-ff55a7a09bb7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.445748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 616/1231] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:45:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:56.452834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:56.546429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:56.587709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50567ef3-5cde-4462-9d86-8f8e068c5fa2 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:56.624067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:56.624774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:56.625053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:56.625325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/1a34d9681ab04766a822de8737a227e0/roles/adb34099014d444b9a3e32bb0a462f09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:56.646275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=1a34d9681ab04766a822de8737a227e0, role_id=adb34099014d444b9a3e32bb0a462f09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:56.648297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e24ce6-d069-4cf8-98d7-6198a3aaffbd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:56.787106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 616/1232] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:45:56 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/1a34d9681ab04766a822de8737a227e0/roles/adb34099014d444b9a3e32bb0a462f09 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:45:59.133047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c953-837b-4cde-be8f-9232adadee0d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.133605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c953-837b-4cde-be8f-9232adadee0d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.133903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53c953-837b-4cde-be8f-9232adadee0d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.136303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 617/1233] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:45:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:59.145050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.145597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.145597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.166367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:59.171903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:59.248667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 617/1234] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:45:59.534963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c953-837b-4cde-be8f-9232adadee0d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.571652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.668048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53c953-837b-4cde-be8f-9232adadee0d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.719591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.720492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.720832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.721165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.735881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:45:59.744048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:45:59.748972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:45:59.750230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 618/1235] 10.222.0.96 () {56 vars in 1102 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:45:59.752587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:59.808835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:59.870492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950cae-a22f-49d7-aafe-d3387924bff9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:59.905008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:59.905663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:59.906153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:59.906678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:59.907759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] RBAC: Adding query filter params (name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:45:59.908128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:59.909578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:59.918654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 618/1236] 10.222.0.96 () {56 vars in 1103 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:45:59.924804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.012638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.030655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951f4b6-3454-4759-8fe5-359fe8fbda77 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.073440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.073440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.073440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.073440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.086413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.087918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:00.103309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:00.104950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:00.106841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:00.106841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:00.106841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:00.106841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 619/1237] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:00.111099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.227767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a1aea8-0909-400a-94dc-2ef6a9829539 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.238094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.263548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.264172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.264488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.264763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.265417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:00.265719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.267115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.282892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 619/1238] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:00.290288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.457343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe8f7-8bc2-4f9d-b007-c0775e430053 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.496421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.497069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.497351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.497624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.500947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.507228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.508719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:00.525670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:00.530283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:00.531399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 620/1239] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:00.532092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.649815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a657a41-3c98-4860-8e64-3e47e0f6c8c1 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.692896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.693548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.693996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.694277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.695039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:00.695350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.696878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:00.724311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 620/1240] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:00.726620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:00.872556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da77ba-7bc2-4e0e-bdde-ce90b2510f77 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:00.913249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:00.913862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:00.914147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:00.914421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:00.988356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.997082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:00.998806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.116600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 621/1241] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:01.126406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.174050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.259587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ec33d-621b-44e6-ace4-093e9e2b7ce8 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.301126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.301783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.302292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.303486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.315056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.316671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:01.335015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:01.336853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:01.338703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:01.338703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:01.338703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:01.338703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 621/1242] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:01.344546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.465317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.472622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fa5ea-af0e-42f9-ae15-d5d62ba45a79 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.521893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.522882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.523364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.523861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.525094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:01.525648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.528283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.550702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 622/1243] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:01.557872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.660918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.686244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d3711-ec88-4a89-8dfd-0140ee413412 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.724629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.725338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.725625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.725903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.733730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.735541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:01.750079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:01.757989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:01.759897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 622/1244] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:01.761028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:01.912436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803af19-caf2-4a52-a9f1-a6395774d7f5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:01.973195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:01.974264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:01.974856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:01.975371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:01.976661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:01.977287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:01.980036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425c5ef-37b0-4346-935b-f8b7b01557ee None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.002911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 623/1245] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:02.010351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:02.130204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5f174-9f27-48ab-9b41-67c624a1650f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:02.176744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:02.177258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:02.177538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:02.178450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:02.179431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] RBAC: Adding query filter params (role.id=adb34099014d444b9a3e32bb0a462f09, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=1a34d9681ab04766a822de8737a227e0) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:02.179744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:02.181334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fab98-a12d-44e7-ad14-19ff6cb61247 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:02.188758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 623/1246] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:02 2022] GET /identity/v3/role_assignments?user.id=1a34d9681ab04766a822de8737a227e0&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=adb34099014d444b9a3e32bb0a462f09 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:04.573676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c391-7b22-42eb-ae62-214bbe05833b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:04.574332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c391-7b22-42eb-ae62-214bbe05833b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:04.574332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426c391-7b22-42eb-ae62-214bbe05833b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:04.575820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 624/1247] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:04.583132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:04.583990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:04.583990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:04.590777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:04.604377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:04.605709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:04.708176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 624/1248] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:04.984161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426c391-7b22-42eb-ae62-214bbe05833b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:05.007692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:05.110848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426c391-7b22-42eb-ae62-214bbe05833b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:05.149777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:05.150768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.151250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.151735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.171060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:05.177177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:05.179756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:05.181372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 625/1249] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:05.186346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:05.306226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3908f-6d23-48c8-a437-3854806104d8 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:05.339667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:05.345175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:05.345786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.346070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.346344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.347025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:05.347331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:05.348774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:05.358367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 625/1250] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:05.367865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:05.458383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:05.484993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65773-3634-449c-84db-b20bf2c654b3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:05.523216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:05.530032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.530032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.530032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.535832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:05.537892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:05.553573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:05.554828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:05.555843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:05.555843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:05.555843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:05.555843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 626/1251] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:05.561274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:05.682226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4c0fb-3d05-408d-a85c-0fd5633b9e88 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:05.721175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:05.721791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.722070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.722412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.723070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:05.723372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:05.724826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:05.737380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 626/1252] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:05.743464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:05.856162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915ab8-6689-42b7-8a14-9a0a902f8d5f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:05.892128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:05.901887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:05.902548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.902824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.903099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.912194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:05.913750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:05.926574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:05.929102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:05.931054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 627/1253] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:05.936571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.019488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.069855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef07dd3b-5444-43b2-8c1d-eac6ed764837 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.109594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.110130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.110409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.110676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.111507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:06.111807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.113318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.135269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 627/1254] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:46:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:06.141940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.298461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ea642-0789-44fd-87d1-d55afa05ae32 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.352894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.353525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.353810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.354087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.416793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.431164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.432694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.539770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 628/1255] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:06.546616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.658475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c205f51-d3f7-44fd-b684-9dc53176afdd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.675271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.700013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.700709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.700949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.701213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.712940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.714422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:06.731270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:06.737233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:06.738458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:06.738458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:06.738458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:06.738458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 628/1256] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:06.739469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.840228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.854646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233db6c3-f5e0-484e-9de6-e6dbb467ed76 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.893669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.894285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.894571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.894851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.895496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:06.895804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.897263 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.910270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 629/1257] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:06.916793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.092542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead16b-0112-4057-8148-98b11f73a995 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.131080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.131720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.131997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.132297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.139802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.141435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:07.153878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:07.160161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:07.161666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 629/1258] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:07.162809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.305514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f209817-9bfd-44a3-936b-60818731f7c3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.367804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.368628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.369099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.369387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.370601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:07.371142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.373834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d5f237-9aab-4792-84fb-bf77e8244187 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.389248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 630/1259] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:07.396122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:07.425675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:07.550348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881d49c-e9ea-4a48-95de-968c4846183c None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:07.588777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:07.591668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:07.591668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:07.591668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:07.591668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=1a34d9681ab04766a822de8737a227e0) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:07.591668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:07.592877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1705da-c9f3-41e4-b816-392385a3458a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:07.599408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 630/1260] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:07 2022] GET /identity/v3/role_assignments?user.id=1a34d9681ab04766a822de8737a227e0&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:09.893373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6596e-218e-4aa4-b610-23dfb56c6e29 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.893922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6596e-218e-4aa4-b610-23dfb56c6e29 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.893922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6596e-218e-4aa4-b610-23dfb56c6e29 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.895223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 631/1261] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:09.901504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.902298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.902298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.921669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:09.923024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:10.002363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 631/1262] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:10.283639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6596e-218e-4aa4-b610-23dfb56c6e29 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.295807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.452011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6596e-218e-4aa4-b610-23dfb56c6e29 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.491292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.496194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.496194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.496194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.505174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:10.511094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:10.512838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:10.514451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:10.516402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 632/1263] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:10.519895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.542061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.628906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862e633-71d8-4eac-aa5f-2a4b01b8bc40 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.670407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.671028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.671431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.671602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.672287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:10.672591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:10.674019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:10.684128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 632/1264] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:10.690280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.768633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.808672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951f54f-3e1d-4fa6-82e7-0fe0a51a69b3 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.848556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.849361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.849687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.850512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.862306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:10.863780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:10.882679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:10.891067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:10.893201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:10.893201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:10.893201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:10.893201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 633/1265] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:10.894509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.989450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.012034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1b99-2fab-403b-8f45-608847f44169 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.058148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.059038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.059417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.059864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.060679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:11.061135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.062640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.077030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 633/1266] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:11.083447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.211104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222ae9d-423c-4de3-8e6c-eb4f35e76c75 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.235702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.252892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.253560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.253855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.254143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.263169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.264687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:11.278121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.284031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:11.285670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 634/1267] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:11.286823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.409170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c79540-9a1d-4daf-8181-4b9f96fa32d7 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.449784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.450556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.450839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.451112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.451867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:11.452174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.453874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.465574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:11.477550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 634/1268] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:11.486964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.676105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133911a0-eddb-4074-944d-e93eb4fdcd5c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:11.746314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:11.747354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:11.747909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:11.748422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:11.769282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:11.782831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:11.801323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:11.802637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:11.804258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:11.804258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:11.804258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:11.808507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 635/1269] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:11.813285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:11.943703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844514d8-579a-484f-a642-dddfe146c73a None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.007726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.008764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.009259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.009735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.010897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.011453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.014084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.036617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 635/1270] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.043623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.082736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.164068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5ecf7-1283-41d8-862d-5f2d2f933e7f None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.205962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.206542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.206823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.207096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.215969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.217660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:12.231511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:12.233223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:12.235071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 636/1271] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:12.242925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.314976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.380613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085eb3-f804-4707-89d2-3b8dadc52fd3 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.421747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.422363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.422645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.422919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.423635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:12.423942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.425659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf2ff94-0f27-4cd6-a1c8-521e87752f25 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.439579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 636/1272] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:12.446719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:12.552294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:12.562802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ceb4-581b-415d-8e14-601e0b85320b None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:12.602377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:12.603058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.603336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.603613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] PATH_INFO: `/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/1a34d9681ab04766a822de8737a227e0/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.605651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] RBAC: Authorizing `identity:create_grant(project_id=37dfa5b58abe4cf397ec97b79a4ea73b, user_id=1a34d9681ab04766a822de8737a227e0, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:12.607178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f816d96-374f-49ed-ab78-47fd6cf9ebf7 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:12.724179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 637/1273] 10.222.0.96 () {58 vars in 1439 bytes} [Thu Sep 8 13:46:12 2022] PUT /identity/v3/projects/37dfa5b58abe4cf397ec97b79a4ea73b/users/1a34d9681ab04766a822de8737a227e0/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:46:15.058281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdf2b-ce5f-4ad0-a1a6-bd71390aa6a1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.059268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdf2b-ce5f-4ad0-a1a6-bd71390aa6a1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.059268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075fdf2b-ce5f-4ad0-a1a6-bd71390aa6a1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.060982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 637/1274] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:15.067209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151067-dc02-4271-a940-e5894534a753 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.067794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151067-dc02-4271-a940-e5894534a753 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.067794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff151067-dc02-4271-a940-e5894534a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.094031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ff151067-dc02-4271-a940-e5894534a753 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:15.095457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ff151067-dc02-4271-a940-e5894534a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:15.175861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 638/1275] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:15.476845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fdf2b-ce5f-4ad0-a1a6-bd71390aa6a1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.612007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075fdf2b-ce5f-4ad0-a1a6-bd71390aa6a1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.634357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.663018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.663676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.663955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.664261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.684515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:46:15.690322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:15.696848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:15.698641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 638/1276] 10.222.0.96 () {56 vars in 1096 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:15.700126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff151067-dc02-4271-a940-e5894534a753 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:15.804832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:15.825324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff151067-dc02-4271-a940-e5894534a753 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:15.864259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:15.864905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:15.865190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:15.865542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:15.866329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:15.867008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:15.868612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:15.880065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 639/1277] 10.222.0.96 () {56 vars in 1099 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:15.886813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.003567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f7295-7aa7-4e08-a25b-cd9001a7204e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.045174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.045832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.046124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.046382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.068053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.070472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:16.094732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:16.096446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:16.098033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:16.098033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:16.098033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:16.098033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 639/1278] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:16.103995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.223245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1376b5-9fd2-4f98-b327-5e33c959d929 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.261472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.262084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.262363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.262633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.263293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:16.263591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.265003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.280188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 640/1279] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:16.287229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.344311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:16.469637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39af78-383c-407c-9afd-50c3ae5e9fcd None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.507615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.508305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.508584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.508851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.517572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.519437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:46:16.533716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:16.535631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:16.537715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 640/1280] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:16.542843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.547276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:16.669901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45883e5-e059-4d19-9f56-6f2f24d240c5 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.713426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.714122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.714451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.714781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:16.715836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:16.716185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:16.717997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:16.751240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 641/1281] 10.222.0.96 () {56 vars in 1143 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:16.757779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:16.879584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:16.891241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce20ce-6e41-455d-b994-a09b208e640e None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:16.929873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:16.930471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:16.930793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:16.931110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.007593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.009207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.113396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.128074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 641/1282] 10.222.0.96 () {58 vars in 1282 bytes} [Thu Sep 8 13:46:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:46:17.135261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.211278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.261007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8006af7-dddf-43d6-9d14-d0643a593174 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.302751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.303517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.303871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.304188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.315962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.317507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:46:17.335311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:17.337083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:46:17.339061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:46:17.339061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:46:17.339061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:17.339061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 642/1283] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:46:17.344770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.463760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be792cfa-feaf-4fe1-a6c0-cd9eae9c1e43 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.509934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.510566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.510852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.511128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.511792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:17.512100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.513548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.526029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 642/1284] 10.222.0.96 () {56 vars in 1109 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:17.532113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.687427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bfb1f-d9e6-4055-beb8-1cb4df545ff4 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:17.712761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.737128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:17.737711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.737995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.738277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.745887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:17.747364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:46:17.759866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:17.761733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: ERROR keystone.server.flask.application Sep 08 13:46:17.763571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 643/1285] 10.222.0.96 () {56 vars in 1111 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:17.772625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.872887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.965322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445a79-7fa4-4beb-a7ea-ba5fa83495a9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.008925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.009552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.009835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.010107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.010813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:18.011127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.012609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1774fc2b-3324-4396-9a38-384cd5311f43 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.026785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 643/1286] 10.222.0.96 () {56 vars in 1148 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:18.036913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:18.162186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19be16-82f0-4f57-830e-c837e9f26429 None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.201467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.202079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.202354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.202626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.203408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] RBAC: Adding query filter params (role.id=ccb1014ef84043b3899f8951beb10ad7, scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b, user.id=1a34d9681ab04766a822de8737a227e0) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:18.203708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.205445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75985009-3fd3-4b39-aa28-9e040922bebe None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.213429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 644/1287] 10.222.0.96 () {56 vars in 1374 bytes} [Thu Sep 8 13:46:18 2022] GET /identity/v3/role_assignments?user.id=1a34d9681ab04766a822de8737a227e0&scope.project.id=37dfa5b58abe4cf397ec97b79a4ea73b&role.id=ccb1014ef84043b3899f8951beb10ad7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:20.544677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8fda-41eb-4924-b5f8-bcce04f4b580 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.545525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8fda-41eb-4924-b5f8-bcce04f4b580 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.545525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e8fda-41eb-4924-b5f8-bcce04f4b580 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.546820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 644/1288] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:20.553452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:20.554067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:20.554067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:20.574544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:20.575778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:20.616724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.668890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 645/1289] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:20.941268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8fda-41eb-4924-b5f8-bcce04f4b580 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.116775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e8fda-41eb-4924-b5f8-bcce04f4b580 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.131256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.158738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.159404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.159689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.159967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.160615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.162059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:21.172141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:21.174373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:21.176040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 645/1290] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:21.181705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.306232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bc21b-7b7d-4d9e-becb-9600aa17d16f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.350162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.353865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9ce1-9a98-44be-81cb-e345f4ed1fc6 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.360147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 646/1291] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:21.367032 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.488875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de6c88-0d25-4d82-84b8-5578d7dd19cc None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.530312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.530942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.531220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.531492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] PATH_INFO: `/v3/services` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.532138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:21.532472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:21.533877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce97a-0044-4427-9d0b-ac4ec82a8fc9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:21.539303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 646/1292] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:46:23.853493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e645-ab29-44f3-885e-0dcf11077569 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.854227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e645-ab29-44f3-885e-0dcf11077569 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.854227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739e645-ab29-44f3-885e-0dcf11077569 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.855404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 647/1293] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:23.861809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c0a2-6c0e-44b1-8ac5-ef37103dd66f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:23.862616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c0a2-6c0e-44b1-8ac5-ef37103dd66f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:23.862814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615c0a2-6c0e-44b1-8ac5-ef37103dd66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:23.884403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a615c0a2-6c0e-44b1-8ac5-ef37103dd66f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:23.885795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a615c0a2-6c0e-44b1-8ac5-ef37103dd66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:23.922132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:23.967313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 647/1294] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:24.250696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e645-ab29-44f3-885e-0dcf11077569 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:24.287456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:24.376301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739e645-ab29-44f3-885e-0dcf11077569 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:24.414939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:24.415563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:24.415844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:24.416118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:24.416833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:24.418227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c56aa-4adf-4829-ad4a-c5b234cf3aee None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:24.509975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 648/1295] 10.222.0.96 () {60 vars in 1141 bytes} [Thu Sep 8 13:46:24 2022] POST /identity/v3/services => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:46:26.845717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14801c-5392-4c4d-a1ac-e89d906c555a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.846243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14801c-5392-4c4d-a1ac-e89d906c555a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.846596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14801c-5392-4c4d-a1ac-e89d906c555a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.849170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 648/1296] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:26.857719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.858288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.858288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.878569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:26.879988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:26.967121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 649/1297] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:46:27.248711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14801c-5392-4c4d-a1ac-e89d906c555a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.369239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d14801c-5392-4c4d-a1ac-e89d906c555a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.408949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.409605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.409889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.410167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.410775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.412179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:27.422774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:27.424719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:27.425900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 649/1298] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:27.436776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.457461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.558757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51957-9dcf-4faf-b2a4-7393aac74d73 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.599900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.601104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.601382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.601742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.602441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] RBAC: Adding query filter params (name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:27.602852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.604278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.610157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 650/1299] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:27.617583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.657665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.782039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aaf28-8329-4558-a790-f222311a92a9 None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:27.822591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:27.823125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:27.823406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:27.823678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:27.824438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] RBAC: Adding query filter params (interface=public, service_id=608e55bd6fc9449e8e1281d4ca18b6b5, region_id=RegionOne) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:27.824751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:27.826298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2dba6-b936-4663-8188-8d33f440b262 None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:27.832446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 650/1300] 10.222.0.96 () {56 vars in 1251 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/endpoints?service_id=608e55bd6fc9449e8e1281d4ca18b6b5&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:27.842119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:27.939326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:27.961596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47d4c9-ed30-49c8-b933-c1a27263002c None admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:28.001203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:28.001834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:28.002123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:28.002400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:28.003025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:28.004526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ceada-202b-4bcd-90c6-ae08e9fb5009 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:28.013023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 651/1301] 10.222.0.96 () {56 vars in 1087 bytes} [Thu Sep 8 13:46:27 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:46:30.319702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465e0c-ef5a-4eb7-b1e8-949279f9e7ba None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.320345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465e0c-ef5a-4eb7-b1e8-949279f9e7ba None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.320345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae465e0c-ef5a-4eb7-b1e8-949279f9e7ba None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.321653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 651/1302] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:46:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:30.328042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.328652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.328746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.349829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:30.351098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:30.431210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 652/1303] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:46:30.709352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465e0c-ef5a-4eb7-b1e8-949279f9e7ba None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.821388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:30.829392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae465e0c-ef5a-4eb7-b1e8-949279f9e7ba None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:30.876661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:30.877350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.877626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.877901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.878509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:30.879919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:46:30.890005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:46:30.891382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application with Lock( Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: ERROR keystone.server.flask.application Sep 08 13:46:30.892650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 652/1304] 10.222.0.96 () {56 vars in 1117 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:46:30.901139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.010038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.036394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c427b6-eba1-4956-a114-7459cfc4079f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.075056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.075732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.076048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.076407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] PATH_INFO: `/v3/services` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.077224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:46:31.077588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.079047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87072e-fb14-4acb-8e27-476a19d62874 None admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.085434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 653/1305] 10.222.0.96 () {56 vars in 1116 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:46:31.092005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:31.218318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d871b2-0048-46d4-b053-5f4c63e0975f None admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.260504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.261036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.261312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.261585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.262326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.263704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21112ea-5cbe-44fd-bc41-e8e2a727088b None admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.423871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 653/1306] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:46:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:46:41.120287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=30 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.418817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:39.329463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ea79-8950-46ca-a531-b77d5e28ed31 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.330683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ea79-8950-46ca-a531-b77d5e28ed31 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.331221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ea79-8950-46ca-a531-b77d5e28ed31 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.339072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08550-d734-4c83-9af2-17e0a777be90 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.340080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08550-d734-4c83-9af2-17e0a777be90 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.340622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef08550-d734-4c83-9af2-17e0a777be90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.344753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 654/1307] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:39 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:39.430925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7ef08550-d734-4c83-9af2-17e0a777be90 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:39.432647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7ef08550-d734-4c83-9af2-17e0a777be90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:39.597010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 654/1308] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:39.936434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.938026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.939763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.945086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 655/1309] 10.222.0.96 () {54 vars in 965 bytes} [Thu Sep 8 13:54:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:39.964068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f21a8-20f3-4648-ac3a-b1b95ea88402 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.964623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f21a8-20f3-4648-ac3a-b1b95ea88402 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.965124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f21a8-20f3-4648-ac3a-b1b95ea88402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.151434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a01f21a8-20f3-4648-ac3a-b1b95ea88402 None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:40.152864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a01f21a8-20f3-4648-ac3a-b1b95ea88402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.201643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:40.334928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 655/1310] 10.222.0.96 () {58 vars in 1062 bytes} [Thu Sep 8 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:40.346405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.350772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.509347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f756908-05df-4ab5-98eb-0f0d9080dda7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:40.611525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:40.612324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.612673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.613018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.615036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.699557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:40.778149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:40.780420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3c115-9e78-404a-91f4-5db4abbc2796 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:40.803508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 656/1311] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:44.050985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.051665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.051769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.053473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 656/1312] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:44.059485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bab9ab-f386-49d1-851d-a5bcfc84ef0e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.059982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bab9ab-f386-49d1-851d-a5bcfc84ef0e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.060130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bab9ab-f386-49d1-851d-a5bcfc84ef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.157205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a0bab9ab-f386-49d1-851d-a5bcfc84ef0e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:44.158525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a0bab9ab-f386-49d1-851d-a5bcfc84ef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.292897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 657/1313] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:44.634084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:44.635742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.764421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ad456-fe42-44d0-95c2-3b7b3a7bfe1f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.841739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:44.844582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.845478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.845972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.846447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.849461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.970995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.972858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4889d-2de9-4a86-8591-6d900c2da4bb service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:44.991969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 657/1314] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:47.862073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.862645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.862645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.864078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 658/1315] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:47.870177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6afbd-d92a-4ee8-9ed5-ede8c9fa38aa None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.870741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6afbd-d92a-4ee8-9ed5-ede8c9fa38aa None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.870741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6afbd-d92a-4ee8-9ed5-ede8c9fa38aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.944554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dbb6afbd-d92a-4ee8-9ed5-ede8c9fa38aa None None] MFA Rules not processed for user `afeb2be505e94df19e94891e551428f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:47.945797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dbb6afbd-d92a-4ee8-9ed5-ede8c9fa38aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:48.005066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:48.052292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 658/1316] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:48.344188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:48.345842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:48.359635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:48.474630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b4431-a0c9-41fc-9c5b-cfbf98c8dd19 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:48.575695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:48.576366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:48.576653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:48.576952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:48.578707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:48.652760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:48.706484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:48.708140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b74d0-83db-4411-8f0a-e9f0aefcaee0 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:48.727917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 659/1317] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:51.818023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8c3-9568-43ef-a3cf-0bd2828b558b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:51.818553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8c3-9568-43ef-a3cf-0bd2828b558b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:51.818553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006e8c3-9568-43ef-a3cf-0bd2828b558b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:51.819829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 659/1318] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:51.825517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a714-fd9b-4a33-9b78-500e229fbea3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:51.825972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a714-fd9b-4a33-9b78-500e229fbea3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:51.826156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2a714-fd9b-4a33-9b78-500e229fbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:51.897880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eec2a714-fd9b-4a33-9b78-500e229fbea3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:51.899125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eec2a714-fd9b-4a33-9b78-500e229fbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:52.001319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 660/1319] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:52.303792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:52.304071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:52.304379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:52.305795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 660/1320] 10.222.0.96 () {54 vars in 965 bytes} [Thu Sep 8 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:54:52.312921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168ad9-5f5f-403d-ac53-a9c0944a2bd1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:52.313738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168ad9-5f5f-403d-ac53-a9c0944a2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:52.313738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42168ad9-5f5f-403d-ac53-a9c0944a2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:52.340788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:52.406569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-42168ad9-5f5f-403d-ac53-a9c0944a2bd1 None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:52.407829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-42168ad9-5f5f-403d-ac53-a9c0944a2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:52.492750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 661/1321] 10.222.0.96 () {58 vars in 1062 bytes} [Thu Sep 8 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:52.502639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:52.504417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:52.624145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dac93-67e4-4af4-a718-0e0853f6b585 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:52.709833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:52.710449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:52.710730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:52.711003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:52.712682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:52.722714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:52.831751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:52.833288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14307e02-cae5-4615-8dd0-2489e956b9c9 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:52.853230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 661/1322] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:56.715865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:56.717209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:56.717209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:56.718276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 662/1323] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:56.724550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061134a-b1ef-4469-8391-21eff0268be7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:56.725090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061134a-b1ef-4469-8391-21eff0268be7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:56.725090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061134a-b1ef-4469-8391-21eff0268be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:56.798492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f061134a-b1ef-4469-8391-21eff0268be7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:56.799712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f061134a-b1ef-4469-8391-21eff0268be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:56.864003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:56.909459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 662/1324] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:57.197160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:57.198717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.323371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f5f13-39eb-483c-9f71-e1b25c089f42 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:57.337775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:57.408697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:57.409194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.409468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.409738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.411328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.535827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:57.537292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b67230-c667-4f6d-9317-4f3082699017 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:57.556861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 663/1325] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:59.839651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:59.840188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:59.840188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:59.842155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 663/1326] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:59.847893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510641-66ba-4bec-949e-b9361778352d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:59.848525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510641-66ba-4bec-949e-b9361778352d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:59.848525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4510641-66ba-4bec-949e-b9361778352d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:59.898410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:59.926808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b4510641-66ba-4bec-949e-b9361778352d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:59.928075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b4510641-66ba-4bec-949e-b9361778352d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:00.045185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 664/1327] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:00.333506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:00.336125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:00.506498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd39ffa-0e71-4139-8534-72345b59b4f4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:00.623471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:00.624190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:00.624570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:00.624861 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:00.626577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:00.647195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:00.756074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:00.757723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c86722-382d-490c-8a00-bb86eba4413b service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:00.784274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 664/1328] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:03.134078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:03.134597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:03.134597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:03.135941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 665/1329] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:03.142330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf28d-7c88-4c32-af63-d4fc86a64e3c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:03.142785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf28d-7c88-4c32-af63-d4fc86a64e3c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:03.143013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcf28d-7c88-4c32-af63-d4fc86a64e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:03.226220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e4dcf28d-7c88-4c32-af63-d4fc86a64e3c None None] MFA Rules not processed for user `afeb2be505e94df19e94891e551428f4`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:03.228070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e4dcf28d-7c88-4c32-af63-d4fc86a64e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:03.313213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:03.347872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 665/1330] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:03.636137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:03.637983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:03.765235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700847-1970-4e2c-8507-df062f36b536 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:03.790287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:03.849074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:03.849688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:03.850097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:03.850403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:03.852074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:03.967524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:03.969148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02f4b1-3c0c-4738-a156-f9e55523328e service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:03.989429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 666/1331] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:06.831990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:06.832560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:06.832670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:06.834099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 666/1332] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:06.839678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979124f2-5506-46e9-ae04-1a04d43071e4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:06.840188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979124f2-5506-46e9-ae04-1a04d43071e4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:06.840188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979124f2-5506-46e9-ae04-1a04d43071e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:06.910394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:06.913443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-979124f2-5506-46e9-ae04-1a04d43071e4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:06.914967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-979124f2-5506-46e9-ae04-1a04d43071e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:07.017755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 667/1333] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:07.307273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:07.308851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:07.420796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d921982-981c-4873-b2fa-3305ae9da43b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:07.504835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:07.505442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:07.505717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:07.505989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:07.507620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:07.536901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:07.624906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:07.626348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c6a08-9edf-4d14-afa2-f552bc4fe5aa service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:07.646013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 667/1334] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:09.897080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:09.897589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:09.897589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:09.898903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 668/1335] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:09.904938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fc86-2bdf-4618-9b17-f3661e96ced5 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:09.905375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fc86-2bdf-4618-9b17-f3661e96ced5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:09.905467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809fc86-2bdf-4618-9b17-f3661e96ced5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:09.971318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7809fc86-2bdf-4618-9b17-f3661e96ced5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:09.972838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7809fc86-2bdf-4618-9b17-f3661e96ced5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:10.046843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:10.069619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 668/1336] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:10.362048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:10.363636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:10.476707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0aed1f-76f4-4f99-bdbc-1684b3f724eb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:10.509196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:10.562733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:10.563348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:10.563684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:10.563959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:10.565817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:10.683031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:10.684530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e41a93-4295-4429-b803-8e016ddf7eeb service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:10.703881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 669/1337] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:13.563502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.564055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.564055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.565755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 669/1338] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:55:13.570927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c323f-6e92-47be-9720-d042d2e2e712 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.571373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c323f-6e92-47be-9720-d042d2e2e712 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.571481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c323f-6e92-47be-9720-d042d2e2e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.644930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f52c323f-6e92-47be-9720-d042d2e2e712 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:13.646613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f52c323f-6e92-47be-9720-d042d2e2e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:13.659217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:13.760659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 670/1339] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:14.046951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:14.048509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:14.156276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6537b-aa06-4ef5-9099-1281fa7f87a2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:14.234597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:14.235213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:14.235490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:14.235770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:14.237408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:14.275039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:14.350809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:14.352160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0313237-1f90-40b6-8b43-9754dc20be34 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:14.370930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 670/1340] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:18.983173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388660-11d9-4453-a635-114beedba921 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.983843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388660-11d9-4453-a635-114beedba921 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.983843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71388660-11d9-4453-a635-114beedba921 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.985357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 671/1341] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:18.991277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8ee9-c625-4f0f-a3cc-115d69acc9d7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.992097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8ee9-c625-4f0f-a3cc-115d69acc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.992097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f8ee9-c625-4f0f-a3cc-115d69acc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:19.089022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a33f8ee9-c625-4f0f-a3cc-115d69acc9d7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:19.091328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a33f8ee9-c625-4f0f-a3cc-115d69acc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.251940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:19.273682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 671/1342] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:19.778860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388660-11d9-4453-a635-114beedba921 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:19.781620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-71388660-11d9-4453-a635-114beedba921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.921640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71388660-11d9-4453-a635-114beedba921 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:19.969802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:20.020193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:20.020947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.021114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.021351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.023007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:20.192427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:20.195201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb534a40-3215-4408-802d-0d4cf5b0e413 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:20.228644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 672/1343] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:23.462732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:23.463309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:23.463309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:23.464650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 672/1344] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:23.473906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b121-4865-4691-9cb9-2cef6b178891 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:23.474438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b121-4865-4691-9cb9-2cef6b178891 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:23.474878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b121-4865-4691-9cb9-2cef6b178891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:23.568105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-15c2b121-4865-4691-9cb9-2cef6b178891 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:23.570221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-15c2b121-4865-4691-9cb9-2cef6b178891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:23.603049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:23.698027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 673/1345] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:23.985297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:23.986820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:24.130046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a53115-db72-4546-8f24-b03cd63f13d2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:24.217652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:24.218653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:24.219138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:24.219614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:24.222805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:24.295082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:24.395419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:24.397478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800a864-3f1e-45f6-b3d6-51bb40a89ecf service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:24.425325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 673/1346] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:29.231484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.232178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.233100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.234883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 674/1347] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:29.242205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9ed4-ec3c-4747-b256-e08aca120aff None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.243010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9ed4-ec3c-4747-b256-e08aca120aff None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.243010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a9ed4-ec3c-4747-b256-e08aca120aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.323270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d47a9ed4-ec3c-4747-b256-e08aca120aff None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:29.324546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d47a9ed4-ec3c-4747-b256-e08aca120aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:29.446696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:29.449687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 674/1348] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:29.895558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:29.897151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:30.013884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b46bb-764f-4ff3-a175-5d390d863ccb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:30.072177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:30.107193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:30.107862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:30.108268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:30.108607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:30.110969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:30.281418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:30.282825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b5a88-abc6-4c73-bff7-c62241213842 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:30.321766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 675/1349] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:35.915684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb311de-5385-4ba2-9eb4-2986ea0da989 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:35.916721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb311de-5385-4ba2-9eb4-2986ea0da989 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:35.917384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb311de-5385-4ba2-9eb4-2986ea0da989 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:35.921562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 675/1350] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 13:55:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:35.929657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0a1e-5851-43d4-a246-da4a986504a6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:35.930244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0a1e-5851-43d4-a246-da4a986504a6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:35.931085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0a1e-5851-43d4-a246-da4a986504a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:36.069316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d46b0a1e-5851-43d4-a246-da4a986504a6 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:36.070906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d46b0a1e-5851-43d4-a246-da4a986504a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:36.106342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:36.244762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 676/1351] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 13:55:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:41.790849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fc08-4eea-480c-9b9b-d9107ad04932 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:41.791418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fc08-4eea-480c-9b9b-d9107ad04932 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:41.791418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fc08-4eea-480c-9b9b-d9107ad04932 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:41.793063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 676/1352] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 13:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:55:41.803000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b151-ce4b-4466-81c6-1091db5396e9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:41.803790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b151-ce4b-4466-81c6-1091db5396e9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:41.803790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b151-ce4b-4466-81c6-1091db5396e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:41.909917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3e06b151-ce4b-4466-81c6-1091db5396e9 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:41.911155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3e06b151-ce4b-4466-81c6-1091db5396e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:42.039113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:42.086971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 677/1353] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:43.030135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedf0e-2a28-4d33-895c-8f4aeb08eebf None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:43.030771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedf0e-2a28-4d33-895c-8f4aeb08eebf None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:43.030771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedf0e-2a28-4d33-895c-8f4aeb08eebf None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:43.032111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 677/1354] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 13:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:43.037422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4367-9131-4672-8ee2-33ed42a45e75 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:43.037980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4367-9131-4672-8ee2-33ed42a45e75 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:43.037980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c4367-9131-4672-8ee2-33ed42a45e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:43.123965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ea6c4367-9131-4672-8ee2-33ed42a45e75 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:43.125136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ea6c4367-9131-4672-8ee2-33ed42a45e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:43.266583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 678/1355] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:47.355548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9d19-0fc0-4cd1-ae30-dde72df1aae6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:47.356886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9d19-0fc0-4cd1-ae30-dde72df1aae6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:47.356886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f9d19-0fc0-4cd1-ae30-dde72df1aae6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:47.358086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 678/1356] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:55:47.364494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f29bf-ad8f-4c43-b723-2e263280058f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:47.365328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f29bf-ad8f-4c43-b723-2e263280058f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:47.365328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f29bf-ad8f-4c43-b723-2e263280058f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:47.420643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:47.483700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-599f29bf-ad8f-4c43-b723-2e263280058f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:47.485829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-599f29bf-ad8f-4c43-b723-2e263280058f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:47.728435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 679/1357] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:48.068317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.069090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.069794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.072465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 679/1358] 10.222.0.96 () {54 vars in 962 bytes} [Thu Sep 8 13:55:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:55:48.082637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758fe5-8ea0-43cc-9ed1-8d2b973ac919 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.083581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758fe5-8ea0-43cc-9ed1-8d2b973ac919 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.084045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758fe5-8ea0-43cc-9ed1-8d2b973ac919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.208273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4a758fe5-8ea0-43cc-9ed1-8d2b973ac919 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:48.209634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a758fe5-8ea0-43cc-9ed1-8d2b973ac919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:48.278002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:48.367331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 680/1359] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Sep 8 13:55:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:48.376041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:48.377886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:48.711096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034866a4-21ad-4df6-979a-cca0a69c4338 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:48.897875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:48.984593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:48.985541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.985996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.986409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.989332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:49.164721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:49.167459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af433c-6e89-4528-8955-6c40db8c63f7 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:49.208266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 680/1360] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:52.314226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:52.315020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:52.315020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:52.316265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 681/1361] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:52.329343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790dd7-654d-4ed4-a414-ade7a144f806 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:52.336885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790dd7-654d-4ed4-a414-ade7a144f806 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:52.336885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af790dd7-654d-4ed4-a414-ade7a144f806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:52.463882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-af790dd7-654d-4ed4-a414-ade7a144f806 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:52.466316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-af790dd7-654d-4ed4-a414-ade7a144f806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:52.546444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:52.675914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 681/1362] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:53.069276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:53.072026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:53.260602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283a484-a179-4929-acac-3bb3c1e4451e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:53.286877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:53.475305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:53.476128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:53.476613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:53.477061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:53.479889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:53.632414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:53.635620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541375e7-a451-40c7-ac37-265efc398183 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:53.674924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 682/1363] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:56.491914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d48b-3a7f-430e-a513-fd325f5b7385 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:56.492521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d48b-3a7f-430e-a513-fd325f5b7385 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:56.492791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288d48b-3a7f-430e-a513-fd325f5b7385 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:56.494309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 682/1364] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:56.500593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc70a4-2f52-4cbe-a79f-3acaa44f8b40 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:56.501108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc70a4-2f52-4cbe-a79f-3acaa44f8b40 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:56.501235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc70a4-2f52-4cbe-a79f-3acaa44f8b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:56.517933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:56.580726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d9dc70a4-2f52-4cbe-a79f-3acaa44f8b40 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:56.581977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d9dc70a4-2f52-4cbe-a79f-3acaa44f8b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:56.779495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1ffd-91f1-4a04-a351-92981fcc8438 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:56.780109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1ffd-91f1-4a04-a351-92981fcc8438 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:56.780733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1ffd-91f1-4a04-a351-92981fcc8438 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:56.784670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 683/1365] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:55:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:56.790773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6088-9145-43c3-8b07-deaf71fe7e97 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:56.795939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6088-9145-43c3-8b07-deaf71fe7e97 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:56.795939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe6088-9145-43c3-8b07-deaf71fe7e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:56.800253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 683/1366] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:56.880633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-affe6088-9145-43c3-8b07-deaf71fe7e97 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:56.881777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-affe6088-9145-43c3-8b07-deaf71fe7e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.024010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 684/1367] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:57.115468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e4a-3364-4629-95a2-c6f57782e5c9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.116181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e4a-3364-4629-95a2-c6f57782e5c9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.117089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a598e4a-3364-4629-95a2-c6f57782e5c9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.120315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 684/1368] 10.222.0.96 () {54 vars in 962 bytes} [Thu Sep 8 13:55:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:55:57.126597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.127146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.127455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.156426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.237196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:57.238562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.326773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8802-81ba-425f-aeec-56e2b727d15a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.327044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8802-81ba-425f-aeec-56e2b727d15a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.327372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8802-81ba-425f-aeec-56e2b727d15a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.329008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 685/1369] 10.222.0.96 () {54 vars in 964 bytes} [Thu Sep 8 13:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:55:57.334247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.334571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.334805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.432811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] MFA Rules not processed for user `448c27a70df04007aca38511444d9037`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:57.433972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.474485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 685/1370] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Sep 8 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:57.484309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.491511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:57.506615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73085c-dcca-4266-b108-c53fcf717b61 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:57.532829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 686/1371] 10.222.0.96 () {58 vars in 1061 bytes} [Thu Sep 8 13:55:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:57.543177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:57.549277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2eb61a-cae8-4f80-adda-19578d839ed0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:57.636078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.665036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:57.665917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.666200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.666474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.668193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.759853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:57.761042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.761628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.762234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.765681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.807882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.812640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:57.814536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8b002-9fa0-4f4b-bf7d-499922023448 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:57.844024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 687/1372] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:57.914943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:57.917197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94b033-936f-466b-b4c1-a253fc59b546 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:57.937383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 686/1373] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:00.628300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:00.628743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:00.628868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:00.630246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 688/1374] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:00.635980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96201d-f28a-42fb-a8ed-1b003bbb7a60 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:00.636541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96201d-f28a-42fb-a8ed-1b003bbb7a60 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:00.637343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb96201d-f28a-42fb-a8ed-1b003bbb7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:00.712378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-eb96201d-f28a-42fb-a8ed-1b003bbb7a60 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:00.713596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-eb96201d-f28a-42fb-a8ed-1b003bbb7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:00.732694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:00.838517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 687/1375] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:01.143052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:01.144733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:01.328170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf15e0-9fa7-4cc2-8109-fc37745ff28b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:01.407195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:01.469418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:01.471499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:01.471499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:01.471499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:01.473746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:01.581853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:01.583454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a078e7-811e-4bcd-bd7d-16b5ebc0fe2f service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:01.605295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 689/1376] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:04.196896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319655bf-fc30-4327-b586-e31457c42734 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.197429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319655bf-fc30-4327-b586-e31457c42734 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.198243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319655bf-fc30-4327-b586-e31457c42734 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.204258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 688/1377] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:04.207659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93cd5-191a-4b3e-8fbf-1ef9649dc895 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.214829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93cd5-191a-4b3e-8fbf-1ef9649dc895 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.214829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a93cd5-191a-4b3e-8fbf-1ef9649dc895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.322054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-01a93cd5-191a-4b3e-8fbf-1ef9649dc895 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:04.323725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-01a93cd5-191a-4b3e-8fbf-1ef9649dc895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:04.356567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:04.509091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 690/1378] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:04.803226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319655bf-fc30-4327-b586-e31457c42734 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.804792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-319655bf-fc30-4327-b586-e31457c42734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:05.024928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319655bf-fc30-4327-b586-e31457c42734 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:05.032323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:05.184989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:05.185786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:05.186082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:05.186342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:05.188531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:05.310103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:05.311892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538eb28-b1aa-4dec-8809-f299a764268f service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:05.333979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 689/1379] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:07.842067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:07.842581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:07.842581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:07.843950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 691/1380] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:07.849865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7a3f-eb13-4c6c-ab4f-008d61b35cf0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:07.850309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7a3f-eb13-4c6c-ab4f-008d61b35cf0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:07.850699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7a3f-eb13-4c6c-ab4f-008d61b35cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:07.856629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:07.938529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3e9c7a3f-eb13-4c6c-ab4f-008d61b35cf0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:07.939787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3e9c7a3f-eb13-4c6c-ab4f-008d61b35cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.091577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 690/1381] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:08.406504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:08.408033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.599672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7794ec1-0d24-4a38-b803-99ff8cfa9eab None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:08.603746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:08.748373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:08.749018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:08.749360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:08.749655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:08.751356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.873617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:08.875122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64996a61-a412-4b7f-9bb6-08c120183588 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:08.909120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 692/1382] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:11.474803 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.475388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.475492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.477570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 691/1383] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:11.485053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40701-2beb-4e4e-9f71-f87508599f4d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.485514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40701-2beb-4e4e-9f71-f87508599f4d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.485641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b40701-2beb-4e4e-9f71-f87508599f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.498056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:11.579307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-61b40701-2beb-4e4e-9f71-f87508599f4d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:11.580622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-61b40701-2beb-4e4e-9f71-f87508599f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:11.701646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 693/1384] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:12.013321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:12.014718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:12.146873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:12.221577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58371d2-34a3-4296-a912-d98d49947ccc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:12.363880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:12.364549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:12.364872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:12.365101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:12.366741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:12.417412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:12.465353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:12.467386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2b71-4bb3-4be0-a38c-1ab6801ca952 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:12.494487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 692/1385] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:14.106434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d066f-143a-4536-9a52-dc9a516f6116 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.106983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d066f-143a-4536-9a52-dc9a516f6116 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.106983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d066f-143a-4536-9a52-dc9a516f6116 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.108384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 694/1386] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:14.114003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e29ed-e64c-47c0-867e-8fae00dcd977 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.114687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e29ed-e64c-47c0-867e-8fae00dcd977 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.114687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e29ed-e64c-47c0-867e-8fae00dcd977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.188525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f72e29ed-e64c-47c0-867e-8fae00dcd977 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:14.190063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f72e29ed-e64c-47c0-867e-8fae00dcd977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:14.319739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 693/1387] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:14.626837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060226-c2c2-41b1-9260-cf933e8ea5eb None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.627102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060226-c2c2-41b1-9260-cf933e8ea5eb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.627414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb060226-c2c2-41b1-9260-cf933e8ea5eb None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.628912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 695/1388] 10.222.0.96 () {54 vars in 961 bytes} [Thu Sep 8 13:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:14.634511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.634799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.635077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.671215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:14.750182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] MFA Rules not processed for user `e34df7c6f30645d292e3595b6c56d134`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:14.751857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:14.800779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f27f-9bed-44ff-b511-869f1edfcd1a None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.801059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f27f-9bed-44ff-b511-869f1edfcd1a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.801333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801f27f-9bed-44ff-b511-869f1edfcd1a None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.802847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 696/1389] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:14.807845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.808126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.810895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.848367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 694/1390] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Sep 8 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:14.857384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:14.865336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c146fc-735e-4616-bd40-9fbae05cb328 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:14.888543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:14.889779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:14.932381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:14.956588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:14.957230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:14.957510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:14.957781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:14.959435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:15.011319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 697/1391] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:15.017554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:15.099613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:15.101133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e112763-4e5d-4dbe-b988-934d54bcf769 service glance] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:15.129344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 695/1392] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:15.309370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:15.310737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:15.452047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c969ab-259c-4c5a-95e8-06ab68bbe003 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:15.519861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:15.590966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:15.592114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:15.592505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:15.592782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:15.594584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:15.699112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:15.700754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077e090-79b7-4a70-b498-e195013d235f service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:15.719851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 698/1393] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:16.037495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e246-514c-43cc-a0e0-28b98df55349 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:16.037869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e246-514c-43cc-a0e0-28b98df55349 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:16.038149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6e246-514c-43cc-a0e0-28b98df55349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:16.121372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-97c6e246-514c-43cc-a0e0-28b98df55349 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:16.122631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-97c6e246-514c-43cc-a0e0-28b98df55349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:16.222943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 696/1394] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:16.277483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:16.277898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:16.278391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:16.280672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 699/1395] 10.222.0.96 () {54 vars in 943 bytes} [Thu Sep 8 13:56:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:16.292296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1751c0-1703-473d-8654-8963264d1d63 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:16.295211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1751c0-1703-473d-8654-8963264d1d63 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:16.295707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1751c0-1703-473d-8654-8963264d1d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:16.302011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:16.382679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0c1751c0-1703-473d-8654-8963264d1d63 None None] MFA Rules not processed for user `a8553aa120db40e6945fbaecf851c363`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:16.383910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0c1751c0-1703-473d-8654-8963264d1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:16.503784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 697/1396] 10.222.0.96 () {58 vars in 1040 bytes} [Thu Sep 8 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:16.514129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:16.515861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:16.588861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:16.676020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897599-7a66-4728-8f25-3f9fc832990f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:16.801165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:16.801777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:16.802058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:16.802335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:16.804028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:16.860390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:16.901291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:16.903597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c91481-352d-48e2-96e2-6ad183a84887 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:16.912093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 700/1397] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 13:56:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:18.154952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:18.155491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:18.155491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:18.160612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 698/1398] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:18.165528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ddb6-0b8e-4d43-926a-972fd6e2af55 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:18.165528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ddb6-0b8e-4d43-926a-972fd6e2af55 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:18.165528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5ddb6-0b8e-4d43-926a-972fd6e2af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:18.241347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f7d5ddb6-0b8e-4d43-926a-972fd6e2af55 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:18.242586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7d5ddb6-0b8e-4d43-926a-972fd6e2af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:18.363741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 701/1399] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:18.685328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:18.687031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:18.779111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:18.893190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a423a9c-0e69-434b-b660-c95182b2e086 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:19.054704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:19.055425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:19.055768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:19.056111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:19.057799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:19.095958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:19.190883 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:19.219018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdb7608-1ae8-4e64-beb8-3edbdfdcd9a8 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:19.219018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 699/1400] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:22.369837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:22.370579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:22.370579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:22.371882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 702/1401] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:22.377399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2870-dc55-42d8-bb7c-b8bf98d300ef None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:22.381953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2870-dc55-42d8-bb7c-b8bf98d300ef None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:22.381953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf2870-dc55-42d8-bb7c-b8bf98d300ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:22.455595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-80bf2870-dc55-42d8-bb7c-b8bf98d300ef None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:22.458296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-80bf2870-dc55-42d8-bb7c-b8bf98d300ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:22.592178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 700/1402] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:22.899495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:22.901089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:22.953296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:23.114275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89639053-a4a9-4495-ade5-ad26e76b57c6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:23.294441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:23.297079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:23.298130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:23.298408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:23.298689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:23.300465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:23.444102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:23.445915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183906dd-5620-42fd-a0e5-cf0936c700e7 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:23.469702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 703/1403] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:25.936941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:25.937513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:25.937513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:25.938739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 701/1404] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:25.944229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9b21-f5a6-460f-9078-ced2769ba4ad None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:25.945071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9b21-f5a6-460f-9078-ced2769ba4ad None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:25.945587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d9b21-f5a6-460f-9078-ced2769ba4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:26.033768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c49d9b21-f5a6-460f-9078-ced2769ba4ad None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:26.035041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c49d9b21-f5a6-460f-9078-ced2769ba4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:26.115820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:26.150380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 704/1405] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:26.453436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:26.455536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:26.459246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:26.652743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1af28-3a81-4a5f-97c4-c847cce16ed4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:26.769275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:26.843498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:26.844469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:26.845038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:26.845488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:26.847801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:26.999945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.002356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfba0d9-3b2e-42f9-bd1a-d14ed4c61dc7 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.024490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 702/1406] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:29.504143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.505013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.505013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.510899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 705/1407] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:56:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:29.514004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cdf0-752e-4242-b6c6-0039f2f9695f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.514596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cdf0-752e-4242-b6c6-0039f2f9695f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.514827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4cdf0-752e-4242-b6c6-0039f2f9695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.610722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-62e4cdf0-752e-4242-b6c6-0039f2f9695f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:29.616966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-62e4cdf0-752e-4242-b6c6-0039f2f9695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:29.661899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:29.763722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 703/1408] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:30.471927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:30.471927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:30.471927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647dd0eb-5b0c-4549-86d3-494a6bb59905 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:30.471927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:30.474513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:30.474513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:30.474513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:30.474513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:30.474883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:30.564465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:30.566117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6cb0e-725a-4ac4-b198-e65bbc871117 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:30.587124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 706/1409] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:39.760278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=26 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:41.344195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=72 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:42.422534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9965-87b9-424e-9e84-dcb274473f10 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:42.423113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9965-87b9-424e-9e84-dcb274473f10 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:42.423113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f9965-87b9-424e-9e84-dcb274473f10 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:42.424432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 704/1410] 10.222.0.96 () {54 vars in 918 bytes} [Thu Sep 8 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:42.429599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb56e5-6f61-4a65-852f-72144ea173d8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:42.430007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb56e5-6f61-4a65-852f-72144ea173d8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:42.430158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb56e5-6f61-4a65-852f-72144ea173d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:42.521361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3dbb56e5-6f61-4a65-852f-72144ea173d8 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:42.523627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3dbb56e5-6f61-4a65-852f-72144ea173d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:42.641055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 707/1411] 10.222.0.96 () {58 vars in 1015 bytes} [Thu Sep 8 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:42.657302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eaa91-635a-47d4-a884-e4758569e838 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:42.657585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eaa91-635a-47d4-a884-e4758569e838 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:42.657862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208eaa91-635a-47d4-a884-e4758569e838 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:42.659206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 705/1412] 10.222.0.96 () {54 vars in 918 bytes} [Thu Sep 8 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:42.664154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9912ca-23ab-4301-8fb2-2a71a00097be None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:42.664478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9912ca-23ab-4301-8fb2-2a71a00097be None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:42.664764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9912ca-23ab-4301-8fb2-2a71a00097be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:42.740183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:42.744577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4a9912ca-23ab-4301-8fb2-2a71a00097be None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:42.746334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a9912ca-23ab-4301-8fb2-2a71a00097be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:42.869931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 708/1413] 10.222.0.96 () {58 vars in 1015 bytes} [Thu Sep 8 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:45.561236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:45.561816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:45.561816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:45.563151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:45.568990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a05e-b648-4ad7-a81f-0653694b4e52 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:45.569476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a05e-b648-4ad7-a81f-0653694b4e52 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:45.569588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a05e-b648-4ad7-a81f-0653694b4e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:45.645214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0543a05e-b648-4ad7-a81f-0653694b4e52 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:45.646594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0543a05e-b648-4ad7-a81f-0653694b4e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:45.705643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:45.750138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:46.044287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:46.045803 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:46.205670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f8426-529f-4c0b-8e73-ed85adee2f9a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:46.283751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:46.325880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:46.326486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:46.326841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:46.327115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:46.328780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:46.422991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:46.424679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354c69-8164-49b4-9ddf-9622830e1d85 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:46.445621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 707/1416] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:47.640724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:47.641389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:47.641389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:47.642689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:47.650631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d981b2-0369-49c5-93ed-2274b60af4fa None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:47.651196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d981b2-0369-49c5-93ed-2274b60af4fa None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:47.651196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d981b2-0369-49c5-93ed-2274b60af4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:47.748887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-40d981b2-0369-49c5-93ed-2274b60af4fa None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:47.750122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-40d981b2-0369-49c5-93ed-2274b60af4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:47.779972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:47.856772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:48.016060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:48.017620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:48.182749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db0fc-50b4-4853-9473-e7da6946ef56 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:48.229412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:48.307192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:48.307789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:48.308225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:48.308496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:48.310078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:48.418150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:48.419730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e16ebb-b004-4258-a6cf-af699ff72985 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:48.438114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 711/1419] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:49.616426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:49.616994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:49.616994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:49.618452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:49.625458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68632-7183-48aa-829a-746a95038e22 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:49.625972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68632-7183-48aa-829a-746a95038e22 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:49.625972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa68632-7183-48aa-829a-746a95038e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:49.689597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:49.714974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5fa68632-7183-48aa-829a-746a95038e22 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:49.716226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5fa68632-7183-48aa-829a-746a95038e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:49.818935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:49.972456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:49.974004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:50.143374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd343323-b777-40d1-9a17-22f65716fdab None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:50.156859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:50.264800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:50.265405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:50.265678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:50.265943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:50.267551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:50.365149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:50.366765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd2ed9-e6d4-4fd2-9ecb-70f684f8c264 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:50.387686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 710/1422] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:51.553081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.553671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.553671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.555026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:51.562418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9258-9370-496c-b451-4971ca52cbae None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.563298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9258-9370-496c-b451-4971ca52cbae None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.563298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a9258-9370-496c-b451-4971ca52cbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.583441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:51.647372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ca8a9258-9370-496c-b451-4971ca52cbae None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:51.649251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ca8a9258-9370-496c-b451-4971ca52cbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:51.754128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:51.906869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:51.908360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:52.031812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:52.074009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f37a6-f1bc-495b-8da7-ec2458b408b7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:52.233757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:52.234273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.234546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.234815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.236574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:52.316777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:52.331935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:52.334191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02d23b-0109-411f-a033-bdcd18d205d0 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:52.354771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 714/1425] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:53.507912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:53.508503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:53.508503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:53.509836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:53.518354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2e79-8171-44d5-8972-e46565b0a8cf None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:53.518935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2e79-8171-44d5-8972-e46565b0a8cf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:53.518935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e2e79-8171-44d5-8972-e46565b0a8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:53.608925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e05e2e79-8171-44d5-8972-e46565b0a8cf None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:53.610184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e05e2e79-8171-44d5-8972-e46565b0a8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:53.724165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:53.876243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:53.877930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:53.973133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:54.063061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b00250-3e5e-4307-9f84-2f1aed0ea5c6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:54.197723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:54.199355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:54.199854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:54.200374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:54.203483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:54.256539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:54.306736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:54.308404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d8a57-68c8-49fa-a98c-5e8d6e135e6e service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:54.328279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 713/1428] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:55.529823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:55.530378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:55.530378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:55.531756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:55.543210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3b6-0290-489d-ab99-32d3eff9d2b0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:55.543780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3b6-0290-489d-ab99-32d3eff9d2b0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:55.544232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96da3b6-0290-489d-ab99-32d3eff9d2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:55.640465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d96da3b6-0290-489d-ab99-32d3eff9d2b0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:55.641713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d96da3b6-0290-489d-ab99-32d3eff9d2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:55.751267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:55.904466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:55.906004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:55.959907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:56.075294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26dc39-9cd3-4f04-93fe-464e0bb31918 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:56.211987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:56.212539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:56.212820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:56.213093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:56.214848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:56.222782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:56.318032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:56.319644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392cc8c-a38d-4217-8546-efd9645455ba service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:56.342521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 717/1431] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:57.540537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:57.541088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:57.541207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:57.542861 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:57.549617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9236b5d-c95c-415e-a01b-6e8ccca89b4d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:57.550167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9236b5d-c95c-415e-a01b-6e8ccca89b4d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:57.550167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9236b5d-c95c-415e-a01b-6e8ccca89b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:57.637326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d9236b5d-c95c-415e-a01b-6e8ccca89b4d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:57.638612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d9236b5d-c95c-415e-a01b-6e8ccca89b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:57.748464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:57.782754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:57.935352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:57.937132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:57.956215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:58.102761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ae810-483e-44c0-86bb-a85ac2cb69fc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:58.206901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:58.238346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:58.238960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:58.239268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:58.239537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:58.241252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:58.353671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:58.355341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc57c7d-31b5-4180-943d-bd1a35aa7e27 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:58.377679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 716/1434] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:59.546126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:59.546683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:59.546683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:59.548085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:59.554797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c68f8-edae-4cea-96f9-f7725eb72d2d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:59.555361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c68f8-edae-4cea-96f9-f7725eb72d2d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:59.555361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c68f8-edae-4cea-96f9-f7725eb72d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:59.638153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7c1c68f8-edae-4cea-96f9-f7725eb72d2d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:59.639413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7c1c68f8-edae-4cea-96f9-f7725eb72d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:59.687191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:59.754109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:59.905048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:59.906524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:00.074733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c5a6a-978c-45b1-9b74-17173672d557 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:00.134891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:00.209795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:00.210380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:00.210699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:00.211219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:00.213305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:00.314823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:00.316744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1424a58-9760-424c-a65d-03ff08b54e0d service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:00.336387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 720/1437] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:01.531236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:01.531926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:01.531926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:01.533438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:01.542260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc6c2-11d4-45b0-a5e5-fba5caef80e9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:01.543304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc6c2-11d4-45b0-a5e5-fba5caef80e9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:01.543437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc6c2-11d4-45b0-a5e5-fba5caef80e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:01.637439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-285fc6c2-11d4-45b0-a5e5-fba5caef80e9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:01.638708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-285fc6c2-11d4-45b0-a5e5-fba5caef80e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:01.641166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:01.751220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:01.909292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:01.910721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:02.090141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c7f2c-6e3c-4641-b6a7-a808934d1f72 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:02.123878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:02.227967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:02.228518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:02.228794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:02.229064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:02.230775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:02.336442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:02.338074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a7aba-396d-4178-b8d3-e02d566c032b service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:02.357114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 719/1440] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:04.506064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:04.506633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:04.506633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:04.507947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:04.513654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365802ec-4689-4829-ba91-b6981576efa5 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:04.514141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365802ec-4689-4829-ba91-b6981576efa5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:04.514239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365802ec-4689-4829-ba91-b6981576efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:04.555973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:04.583409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-365802ec-4689-4829-ba91-b6981576efa5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:04.584764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-365802ec-4689-4829-ba91-b6981576efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:04.692947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:04.983952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:04.985603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:05.098178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97f138-adb2-4fe0-a35b-75ed52b7bfc2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:05.134691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:05.180393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:05.181013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:05.181292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:05.181568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:05.183231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:05.307120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:05.308609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f77a0-59b1-41ae-8daf-178b0c22c881 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:05.330920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 723/1443] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:07.786494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:07.787406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:07.787406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:07.789142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:07.795432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957fa6-26f0-45df-bcaf-f8b3f52c7f62 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:07.800756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957fa6-26f0-45df-bcaf-f8b3f52c7f62 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:07.800756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5957fa6-26f0-45df-bcaf-f8b3f52c7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:07.878012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d5957fa6-26f0-45df-bcaf-f8b3f52c7f62 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:07.879463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d5957fa6-26f0-45df-bcaf-f8b3f52c7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:07.894842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:07.993834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:08.286081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:08.287884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:08.414974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33c1cf-66cb-490e-b5b2-2ff501f5d728 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:08.430453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:08.518261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:08.518876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:08.519162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:08.519464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:08.521235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:08.662816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:08.664459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09956703-49ba-402d-b9cf-2113f7fa8f36 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:08.687976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 722/1446] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:11.398706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:11.399324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:11.399324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:11.400787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:11.407750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbc52-ec37-4fba-96ca-392c0e4ff4d2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:11.409475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbc52-ec37-4fba-96ca-392c0e4ff4d2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:11.409475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddbc52-ec37-4fba-96ca-392c0e4ff4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:11.459809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:11.480872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c9ddbc52-ec37-4fba-96ca-392c0e4ff4d2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:11.482146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c9ddbc52-ec37-4fba-96ca-392c0e4ff4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:11.598128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:11.891734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:11.893307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:12.022066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184a265-4f7b-403b-b3d3-36c4f779e6bb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:12.068404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:12.230689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:12.231195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:12.231474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:12.231749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:12.233472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:12.372066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:12.373727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442330-f54c-4486-8789-90a77a79908a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:12.394829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 726/1449] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:14.841014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:14.841603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:14.841603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:14.843164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:14.848954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec0e7-6e05-454f-83bd-06bf6b298067 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:14.849389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec0e7-6e05-454f-83bd-06bf6b298067 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:14.849525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ec0e7-6e05-454f-83bd-06bf6b298067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:14.943084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ce5ec0e7-6e05-454f-83bd-06bf6b298067 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:14.944356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ce5ec0e7-6e05-454f-83bd-06bf6b298067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:14.967281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:15.054984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:15.344666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:15.346366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:15.476993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d46a47-4f1e-4116-b8f4-7b292f68da88 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:15.499903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:15.558848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:15.559499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:15.559779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:15.560051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:15.561856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:15.687548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:15.689954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2158a-1960-4a34-b60a-03ef36317030 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:15.713927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 725/1452] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:18.063746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.064383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.064383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.065744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:18.071709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b852-5a75-4ffc-b141-369119ab666d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.072285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b852-5a75-4ffc-b141-369119ab666d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.072285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13b852-5a75-4ffc-b141-369119ab666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.145851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:18.148853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8d13b852-5a75-4ffc-b141-369119ab666d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:18.150106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8d13b852-5a75-4ffc-b141-369119ab666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:18.258586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:18.551938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:18.553552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:18.672080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f9955-1c1c-424c-a07c-ca622948a50d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:18.725705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:18.752040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:18.752760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.753036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.753411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.755934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:18.909358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:18.910804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f04d7-dd00-41bb-962c-13dcbd82a6b1 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:18.933551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 729/1455] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:21.285647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:21.286352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:21.286352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:21.287552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:21.295855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28a7a-3ec4-46f6-94c0-ccba0f3b98fe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:21.296485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28a7a-3ec4-46f6-94c0-ccba0f3b98fe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:21.296485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e28a7a-3ec4-46f6-94c0-ccba0f3b98fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:21.372545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a5e28a7a-3ec4-46f6-94c0-ccba0f3b98fe None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:21.373788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a5e28a7a-3ec4-46f6-94c0-ccba0f3b98fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:21.408794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:21.492818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:21.783967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:21.785600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:21.914016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb2150-a017-4055-b90a-83701ba916e1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:21.947725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:22.003537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:22.004151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:22.004468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:22.004743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:22.006390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:22.144484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:22.145942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c573bc-45e8-4ae7-a129-ea936f2092ad service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:22.167784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 728/1458] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:24.538092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:24.538659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:24.538798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:24.540358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:24.547516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b298-8eb4-4007-9e7f-13480d9675b3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:24.548147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b298-8eb4-4007-9e7f-13480d9675b3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:24.548320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57b298-8eb4-4007-9e7f-13480d9675b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:24.626181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1e57b298-8eb4-4007-9e7f-13480d9675b3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:24.627325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1e57b298-8eb4-4007-9e7f-13480d9675b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:24.636434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:24.743768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:25.039727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:25.041327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:25.169539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445f610-dc31-4c48-84d7-c23c394a229b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:25.244679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:25.278677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:25.279710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:25.280162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:25.280995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:25.283680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:25.420358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:25.421858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28dfc-b60f-477a-9a3d-de9773b39257 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:25.444374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 732/1461] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:27.814843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:27.815359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:27.815359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:27.816714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:27.822400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731f8f-d893-411f-94f7-0ec000507867 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:27.822882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731f8f-d893-411f-94f7-0ec000507867 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:27.823002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731f8f-d893-411f-94f7-0ec000507867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:27.900293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-62731f8f-d893-411f-94f7-0ec000507867 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:27.901603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-62731f8f-d893-411f-94f7-0ec000507867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:27.948780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:28.016855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:28.311465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:28.313295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.475879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0b1f6-96ae-4c88-a9e8-20dc9d2700e1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:28.522863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:28.569511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:28.570192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:28.570680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:28.570998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:28.579012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.716908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:28.718640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61178119-3634-4b9d-9ca4-d3229375e2cb service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:28.739897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 731/1464] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:31.034693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:31.035272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:31.035272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:31.036874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:31.043293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918932eb-4fc4-460e-8c6f-aae03540ce9f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:31.043797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918932eb-4fc4-460e-8c6f-aae03540ce9f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:31.043911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918932eb-4fc4-460e-8c6f-aae03540ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:31.129014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-918932eb-4fc4-460e-8c6f-aae03540ce9f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:31.130262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-918932eb-4fc4-460e-8c6f-aae03540ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:31.151841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:31.247421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:31.538963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:31.540596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:31.658853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fa017-37c4-4608-a69c-4e46925fd518 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:31.736364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:31.742961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:31.743573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:31.743850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:31.744124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:31.746446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:31.871596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:31.873056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d2b63-7d30-4236-a11e-711a6bdc5981 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:31.894201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 735/1467] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:34.170624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:34.171229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:34.171229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:34.172587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:34.178609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b7c4-456e-47a0-b913-1cb3ee895bbe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:34.179125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b7c4-456e-47a0-b913-1cb3ee895bbe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:34.179286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b7c4-456e-47a0-b913-1cb3ee895bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:34.259827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7382b7c4-456e-47a0-b913-1cb3ee895bbe None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:34.261679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7382b7c4-456e-47a0-b913-1cb3ee895bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:34.315280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:34.371775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:34.656897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:34.658532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:34.775189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62113d-38cb-4e31-a866-04dab2810411 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:34.833951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:34.862600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:34.863246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:34.863527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:34.863802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:34.865673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:34.989442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:34.990952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239a53-f846-4fd5-af16-ea625d323f51 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:35.014572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 734/1470] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:44.369435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=22 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:45.011409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=66 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:55.831722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ccbb-61fb-457a-99f1-c8861dac8c97 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:55.832290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ccbb-61fb-457a-99f1-c8861dac8c97 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:55.832290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71ccbb-61fb-457a-99f1-c8861dac8c97 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:55.833569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 737/1471] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:55.839064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472845b-38d0-4fe1-89b7-c88c6f2ca17d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:55.839474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472845b-38d0-4fe1-89b7-c88c6f2ca17d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:55.839638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472845b-38d0-4fe1-89b7-c88c6f2ca17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:55.908909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a472845b-38d0-4fe1-89b7-c88c6f2ca17d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:55.910215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a472845b-38d0-4fe1-89b7-c88c6f2ca17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:56.012845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 735/1472] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:56.316763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:56.317049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:56.317323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:56.318646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 738/1473] 10.222.0.96 () {54 vars in 961 bytes} [Thu Sep 8 13:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:56.324312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671de5-f577-4407-ba34-2499deb46bb7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:56.324599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671de5-f577-4407-ba34-2499deb46bb7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:56.324870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59671de5-f577-4407-ba34-2499deb46bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:56.404935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-59671de5-f577-4407-ba34-2499deb46bb7 None None] MFA Rules not processed for user `e34df7c6f30645d292e3595b6c56d134`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:56.406138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-59671de5-f577-4407-ba34-2499deb46bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:56.428412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:56.484837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 736/1474] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Sep 8 13:57:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:56.492860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:56.494345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:56.599615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a1f73-1423-4641-8015-6245344b313f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:56.680033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:56.680988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:56.681488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:56.681985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:56.684705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:56.742102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:56.797584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:56.798652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b693-55c6-40f6-90e6-c4c88d197b97 service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:56.818822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 739/1475] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:59.137623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:59.138138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:59.138138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:59.139398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 737/1476] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:57:59.145023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091d50-1b88-4374-88ec-3c9fdc8d1b75 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:59.145512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091d50-1b88-4374-88ec-3c9fdc8d1b75 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:59.145959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67091d50-1b88-4374-88ec-3c9fdc8d1b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:59.217440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-67091d50-1b88-4374-88ec-3c9fdc8d1b75 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:59.218666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-67091d50-1b88-4374-88ec-3c9fdc8d1b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:59.320489 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 740/1477] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:59.600181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:59.602004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:59.750805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d6d92-f538-4139-8bf2-fcecc20e3eed None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:59.802158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:59.848249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:59.848780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:59.849055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:59.849327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:59.849967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:59.852045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:57:59.852045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 13:57:59.852045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 13:57:59.853215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866109-c151-4e94-9550-eaac17af6d05 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:59.873099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 738/1478] 10.222.0.96 () {56 vars in 1108 bytes} [Thu Sep 8 13:57:59 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:58:02.077468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:02.078062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:02.078062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:02.079352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 741/1479] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:58:02.084832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf662c8-f8cb-469d-a9e5-0d855d4a4334 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:02.085294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf662c8-f8cb-469d-a9e5-0d855d4a4334 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:02.085391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf662c8-f8cb-469d-a9e5-0d855d4a4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:02.158226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-baf662c8-f8cb-469d-a9e5-0d855d4a4334 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:02.159471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-baf662c8-f8cb-469d-a9e5-0d855d4a4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:02.259619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 739/1480] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:02.555217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:02.556831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:02.569864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:02.710251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95ff67-3d5a-4756-916b-48820a65513b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:02.795416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:02.834499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:02.835137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:02.835441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:02.835715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:02.837361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:02.933823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:02.935465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19238acd-d056-4fa4-9c40-9c6216877e1a service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:02.954643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 742/1481] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:05.342432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:05.343040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:05.343426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:05.346047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 740/1482] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:58:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:58:05.351757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e149-59b0-4f28-8a6e-cbc55ecc4424 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:05.352638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e149-59b0-4f28-8a6e-cbc55ecc4424 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:05.352638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e149-59b0-4f28-8a6e-cbc55ecc4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:05.423872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0643e149-59b0-4f28-8a6e-cbc55ecc4424 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:05.425180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0643e149-59b0-4f28-8a6e-cbc55ecc4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:05.475862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:05.537788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 743/1483] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:05.844866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:05.846621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:05.874140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:05.970326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cda5e8-2aa4-41dc-a835-ccb1c2509949 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:06.054553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:06.055167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:06.055445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:06.055713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:06.057401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:06.343965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:06.387884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:06.389425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd1eb4-4c30-4176-82b6-0aba666f3b02 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:06.408164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 741/1484] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:08.685531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:08.686048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:08.686048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:08.687360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 744/1485] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:58:08.692760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca3b62-774a-415e-a31c-af9de0799604 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:08.693221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca3b62-774a-415e-a31c-af9de0799604 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:08.693322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca3b62-774a-415e-a31c-af9de0799604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:08.761720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-84ca3b62-774a-415e-a31c-af9de0799604 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:08.762935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-84ca3b62-774a-415e-a31c-af9de0799604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:08.860620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 742/1486] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:58:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:09.155351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:09.156955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:09.267874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa606c7-0a4f-4be6-ac7e-6e096131d169 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:09.343244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:09.344788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:09.345342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:09.345622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:09.345895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:09.347563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:09.463349 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:09.464782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f67e5-26e4-4e4b-ae68-6758cfe379d5 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:09.482831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 745/1487] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:11.849314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:11.849885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:11.849993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:11.851297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 743/1488] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:58:11.857637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94bac-b5cd-40a2-aa64-65a12f585d3f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:11.858100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94bac-b5cd-40a2-aa64-65a12f585d3f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:11.858224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a94bac-b5cd-40a2-aa64-65a12f585d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:11.927485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-12a94bac-b5cd-40a2-aa64-65a12f585d3f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:11.928705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-12a94bac-b5cd-40a2-aa64-65a12f585d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:11.984950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:12.032059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 746/1489] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:12.329534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:12.331054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:12.371027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:12.445133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedd964-cc02-418c-adae-a7ba734115d4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:12.523127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:12.523742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:12.524068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:12.524369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:12.526032 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:12.608461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:12.637693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:12.639027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0d9d9-62d4-44b4-8b21-11ed487b64de service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:12.656966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 744/1490] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:15.240902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:15.241526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:15.241526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:15.242888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 747/1491] 10.222.0.96 () {54 vars in 927 bytes} [Thu Sep 8 13:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:58:15.248863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193ab-7a5b-4c1b-82cc-3abc3659bc4e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:15.249397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193ab-7a5b-4c1b-82cc-3abc3659bc4e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:15.249397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016193ab-7a5b-4c1b-82cc-3abc3659bc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:15.320188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-016193ab-7a5b-4c1b-82cc-3abc3659bc4e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:15.321477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-016193ab-7a5b-4c1b-82cc-3abc3659bc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:15.431127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 745/1492] 10.222.0.96 () {58 vars in 1024 bytes} [Thu Sep 8 13:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:15.727022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:15.728843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:15.836391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce6dd-9392-4521-a206-6fb7a4bfb5bd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:15.911388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:15.911991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:15.912298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:15.912574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:15.914218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:15.923446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:16.026704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:16.028102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81002125-e982-4088-ab31-dcfcfdc708b6 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:16.049038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 748/1493] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:25.429440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=82 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:26.046763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=50 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:43.030308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.030918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.030918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.125596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:43.126805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:43.232431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 746/1494] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:43.240776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.241285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.241390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.261928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:43.263137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:43.272381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 749/1495] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:43.277211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.287394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c8fac-ab3c-4841-a7ff-d5d23f4e9dab None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.292057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.292696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.292975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.293245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.293894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:59:43.294194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.295214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.295214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 13:59:43.295214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 13:59:43.296122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.307949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 747/1496] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 13:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:59:43.317011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.326199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b9391-5947-4e85-852f-f3e02cef464c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.331477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.332076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.332391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.332667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.333326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.335056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.335056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 13:59:43.335056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 13:59:43.336257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.417600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 750/1497] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:43.422245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.432371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991fd67-57e8-41eb-beba-ffe4b82a4cd7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.488183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:43.496311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.496920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.497198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.497466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.498093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.499804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.499804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 13:59:43.499804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 13:59:43.501035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.617395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 748/1498] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:43.621809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.633205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad3af4-40fe-4448-9bb0-f87ccdbba68d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.637884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.638510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.638823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.639152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.639804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.640840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.640840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 13:59:43.640840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 13:59:43.641720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.654670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 751/1499] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:59:43.658977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.668911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c35991-4a37-4ffd-a57b-eaf71093030e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.674191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.674793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.675065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.675330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.675972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.677035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.677035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 13:59:43.677035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 13:59:43.677931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4879dfd-c7ad-4add-aa80-73a1aeb6d292 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.692442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 749/1500] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:43.696884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.708549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620feb11-7ef5-499f-a0ed-0d856e620405 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.714614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.715641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.715919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.716194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] PATH_INFO: `/v3/projects/50cd1bd30ba34cddbf53788a81b0ec43/users/780655b4940b412d8790bf9d5f97ba42/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.731314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50cd1bd30ba34cddbf53788a81b0ec43, user_id=780655b4940b412d8790bf9d5f97ba42, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.732378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:43.732378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 13:59:43.732378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 13:59:43.734840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a6116-ac7a-4082-8a01-017dc41bee59 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.845271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 752/1501] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:43 2022] PUT /identity/v3/projects/50cd1bd30ba34cddbf53788a81b0ec43/users/780655b4940b412d8790bf9d5f97ba42/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:43.858462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0aadb-4c86-407e-a5e6-8e724fb101d6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.862681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0aadb-4c86-407e-a5e6-8e724fb101d6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.862681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0aadb-4c86-407e-a5e6-8e724fb101d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.886713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c3e0aadb-4c86-407e-a5e6-8e724fb101d6 None None] MFA Rules not processed for user `780655b4940b412d8790bf9d5f97ba42`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:43.887874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c3e0aadb-4c86-407e-a5e6-8e724fb101d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:43.951610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 750/1502] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:43.964809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38694-b992-4608-bb7a-4873c8503795 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.965093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38694-b992-4608-bb7a-4873c8503795 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.965392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38694-b992-4608-bb7a-4873c8503795 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.966728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 753/1503] 10.222.0.96 () {54 vars in 964 bytes} [Thu Sep 8 13:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:59:43.972476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12cff-f935-41c7-9697-88a4a5c03408 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.972790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12cff-f935-41c7-9697-88a4a5c03408 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.973070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b12cff-f935-41c7-9697-88a4a5c03408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.036319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c4b12cff-f935-41c7-9697-88a4a5c03408 None None] MFA Rules not processed for user `448c27a70df04007aca38511444d9037`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:44.037578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c4b12cff-f935-41c7-9697-88a4a5c03408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.115937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 751/1504] 10.222.0.96 () {58 vars in 1061 bytes} [Thu Sep 8 13:59:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:44.125795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38694-b992-4608-bb7a-4873c8503795 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.136789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38694-b992-4608-bb7a-4873c8503795 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.140333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.140926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.141208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.141476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.150323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.151759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.161565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 754/1505] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:44.208884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df59b3-c5b8-42cc-b903-d78a6a07c6c6 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.209176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df59b3-c5b8-42cc-b903-d78a6a07c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.209454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df59b3-c5b8-42cc-b903-d78a6a07c6c6 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.210725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 752/1506] 10.222.0.96 () {52 vars in 830 bytes} [Thu Sep 8 13:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:59:44.214709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.277123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b21a6e1-fd94-4027-bc1f-7af225cefc63 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.282427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.283075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.283357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.283628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] PATH_INFO: `/v3/users/780655b4940b412d8790bf9d5f97ba42` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.284777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780655b4940b412d8790bf9d5f97ba42)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.285782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:44.285782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 13:59:44.285782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 13:59:44.286974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.501219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780655b4940b412d8790bf9d5f97ba42'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.585854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780655b4940b412d8790bf9d5f97ba42'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.612033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780655b4940b412d8790bf9d5f97ba42'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.612808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780655b4940b412d8790bf9d5f97ba42'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.626286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:44.628746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780655b4940b412d8790bf9d5f97ba42'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.635043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 755/1507] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:44 2022] DELETE /identity/v3/users/780655b4940b412d8790bf9d5f97ba42 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:44.640217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.640532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.640811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.660922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:44.663988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.674487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:44.724805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 753/1508] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:44.736548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.737986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.825920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5002c6-528a-4488-b2a8-1ee1bdfb8324 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.830400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.831025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.831303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.832038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.841620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.843054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c5f74-f8b1-4085-9763-51530ae20581 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.852689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 756/1509] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:45.331388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.332864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:45.346619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3dd73-e70b-4b80-a55a-ebe1bda55743 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.352641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.353303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.353736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.354023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] PATH_INFO: `/v3/projects/50cd1bd30ba34cddbf53788a81b0ec43` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.355201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=50cd1bd30ba34cddbf53788a81b0ec43)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.356553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:59:45.356553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 13:59:45.356553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 13:59:45.357789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.495462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50cd1bd30ba34cddbf53788a81b0ec43', 'request_id': 'req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:45.517507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50cd1bd30ba34cddbf53788a81b0ec43', 'request_id': 'req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:45.521730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50cd1bd30ba34cddbf53788a81b0ec43', 'request_id': 'req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:45.628492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] The token cache is being invalidate because project 50cd1bd30ba34cddbf53788a81b0ec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:45.628722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:45.629396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1b63d738-2fa8-4e1b-84a2-21ab6412e04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:45.631048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 754/1510] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:45 2022] DELETE /identity/v3/projects/50cd1bd30ba34cddbf53788a81b0ec43 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:54.848319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=38 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:55.625074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:26.070455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:26.071086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:26.071086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:26.072464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:26.077977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1955e-a147-45b6-9578-d9d2d8f35a99 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:26.078476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1955e-a147-45b6-9578-d9d2d8f35a99 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:26.078580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1955e-a147-45b6-9578-d9d2d8f35a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:26.097869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-99d1955e-a147-45b6-9578-d9d2d8f35a99 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:26.099077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-99d1955e-a147-45b6-9578-d9d2d8f35a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:26.175947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:26.332951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:26.334766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:26.444213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1682d-18f8-46f9-b9a3-9c4d09d91a36 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:26.449955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:26.450560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:26.450841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:26.451121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:26.459530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:26.461163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9635f9-26f8-4079-a5a9-bd9ea348c780 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:26.471052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 758/1513] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:27.573950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a01c-2e1c-49e3-a1e6-e088e4b21438 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:27.574500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a01c-2e1c-49e3-a1e6-e088e4b21438 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:27.574500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055a01c-2e1c-49e3-a1e6-e088e4b21438 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:27.575863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:01:27.582329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e173c1-54d9-470d-82ce-2cc4af9c3b59 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:27.582851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e173c1-54d9-470d-82ce-2cc4af9c3b59 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:27.582956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e173c1-54d9-470d-82ce-2cc4af9c3b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:27.602608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-34e173c1-54d9-470d-82ce-2cc4af9c3b59 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:27.603854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-34e173c1-54d9-470d-82ce-2cc4af9c3b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:27.612068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:27.767129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055a01c-2e1c-49e3-a1e6-e088e4b21438 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:27.781246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055a01c-2e1c-49e3-a1e6-e088e4b21438 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:27.786561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:27.787153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:27.787431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:27.787705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:27.795750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:27.797354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a3cf9-3cb8-4449-8094-3efc978fa2fd service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:27.807134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 757/1516] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:29.113413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a769-a756-496d-bfc9-df6d53531e89 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:29.113985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a769-a756-496d-bfc9-df6d53531e89 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:29.113985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3a769-a756-496d-bfc9-df6d53531e89 None None] PATH_INFO: `/v3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:29.115359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 760/1517] 10.222.0.102 () {54 vars in 926 bytes} [Thu Sep 8 14:01:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:01:29.136689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19815d-c133-4041-b6c1-148e4b183aa0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:29.137226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19815d-c133-4041-b6c1-148e4b183aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:29.137226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19815d-c133-4041-b6c1-148e4b183aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:29.190175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-bb19815d-c133-4041-b6c1-148e4b183aa0 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:29.191396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bb19815d-c133-4041-b6c1-148e4b183aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:29.270053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 758/1518] 10.222.0.102 () {58 vars in 1016 bytes} [Thu Sep 8 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:37.603830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=49 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:39.265919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=77 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:39.327624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa177e-8d85-4851-9e54-0b282b088727 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.328231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa177e-8d85-4851-9e54-0b282b088727 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.328231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa177e-8d85-4851-9e54-0b282b088727 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.329619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 761/1519] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:39.336442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b95425-897b-419c-a696-fde83cab1e02 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.336743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b95425-897b-419c-a696-fde83cab1e02 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.337016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b95425-897b-419c-a696-fde83cab1e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.359028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d0b95425-897b-419c-a696-fde83cab1e02 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:39.360296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d0b95425-897b-419c-a696-fde83cab1e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:39.368760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 759/1520] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:39.526974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa177e-8d85-4851-9e54-0b282b088727 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:39.544308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa177e-8d85-4851-9e54-0b282b088727 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:39.549835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:39.550427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.550705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.550978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.563015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:39.563015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6d9d7-4a60-40b5-987d-8555bf478ca0 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:39.573158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 762/1521] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:39.907036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a138-f489-47d1-90ff-71abda55f731 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.907512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a138-f489-47d1-90ff-71abda55f731 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.907854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192a138-f489-47d1-90ff-71abda55f731 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.909344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 760/1522] 10.222.0.96 () {54 vars in 961 bytes} [Thu Sep 8 14:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:39.914475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e04d-c682-4ae6-943e-dd24c5ef0312 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.914962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e04d-c682-4ae6-943e-dd24c5ef0312 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.915290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e04d-c682-4ae6-943e-dd24c5ef0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.936266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b1b8e04d-c682-4ae6-943e-dd24c5ef0312 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:39.937511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b1b8e04d-c682-4ae6-943e-dd24c5ef0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:39.947458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 763/1523] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Sep 8 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:39.955191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a138-f489-47d1-90ff-71abda55f731 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:39.971624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192a138-f489-47d1-90ff-71abda55f731 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:39.977742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:39.978519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:39.978850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:39.979129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:39.988441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:39.994822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd319edd-c90c-4756-8530-aa7c3c103dd1 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:40.000635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 761/1524] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:40.684114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745805-6699-453c-841b-9aa334d06bac None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:40.684643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745805-6699-453c-841b-9aa334d06bac None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:40.684753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745805-6699-453c-841b-9aa334d06bac None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:40.686060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 14:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:40.692893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca694a-0666-4d98-8443-6236ae27cbac None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:40.693354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca694a-0666-4d98-8443-6236ae27cbac None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:40.694638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca694a-0666-4d98-8443-6236ae27cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:40.714002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e4ca694a-0666-4d98-8443-6236ae27cbac None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:40.715447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e4ca694a-0666-4d98-8443-6236ae27cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:40.724622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:40.884335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745805-6699-453c-841b-9aa334d06bac None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:40.899149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745805-6699-453c-841b-9aa334d06bac None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:40.904869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:40.905480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:40.905752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:40.906021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:40.915016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:40.917280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88aed0-778c-4d9f-8f30-03469bd0979c service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:40.927318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 765/1527] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:44.999707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:45.000320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:45.000468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:45.002739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:45.008693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dacc6-df38-42af-acb7-574a98316178 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:45.011111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dacc6-df38-42af-acb7-574a98316178 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:45.011111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99dacc6-df38-42af-acb7-574a98316178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:45.030369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f99dacc6-df38-42af-acb7-574a98316178 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:45.031734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f99dacc6-df38-42af-acb7-574a98316178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:45.040259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:45.343809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:45.345585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:45.409030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764096-25af-4c3a-afbc-04772df79c39 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:45.412834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:45.416230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:45.416230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:45.416230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:45.423869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:45.425367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d8f3a-67d8-4778-8de6-d11aa5a8ff15 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:45.435679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 764/1530] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:47.710449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534023fc-2504-4257-8e8e-0646d29bc491 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:47.711072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534023fc-2504-4257-8e8e-0646d29bc491 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:47.711072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534023fc-2504-4257-8e8e-0646d29bc491 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:47.712442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:47.719406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995d8a-f3f2-4ba6-b33f-5d0a4e53de93 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:47.720002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995d8a-f3f2-4ba6-b33f-5d0a4e53de93 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:47.720002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11995d8a-f3f2-4ba6-b33f-5d0a4e53de93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:47.742751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-11995d8a-f3f2-4ba6-b33f-5d0a4e53de93 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:47.744629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-11995d8a-f3f2-4ba6-b33f-5d0a4e53de93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:47.753068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:48.054239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534023fc-2504-4257-8e8e-0646d29bc491 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:48.070880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534023fc-2504-4257-8e8e-0646d29bc491 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:48.076537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:48.077356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:48.077837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:48.078313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:48.089798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:48.091240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8701c9be-fc38-4883-b24d-82af28924e17 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:48.102182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 768/1533] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:51.904227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:51.904742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:51.904742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:51.906048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:51.911600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054bc-2425-48d2-8a60-64f24e6649ed None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:51.912018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054bc-2425-48d2-8a60-64f24e6649ed None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:51.912147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7054bc-2425-48d2-8a60-64f24e6649ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:51.932197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3d7054bc-2425-48d2-8a60-64f24e6649ed None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:51.933442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3d7054bc-2425-48d2-8a60-64f24e6649ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:51.941455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:52.250156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:52.251866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:52.311026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e73b43-a3ae-4c12-9176-e90d7cef9a31 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:52.314602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:52.315210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:52.315557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:52.315837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:52.325866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:52.327286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054eb3d-8f5d-40a5-b0a9-b58ba8969f2b service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:52.336687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 767/1536] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:54.552956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.553607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.553607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.554844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 14:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:01:54.560772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c730-0a48-4d37-8094-fa564be0e65a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.561475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c730-0a48-4d37-8094-fa564be0e65a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.561475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c6c730-0a48-4d37-8094-fa564be0e65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.582252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-44c6c730-0a48-4d37-8094-fa564be0e65a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:54.583486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-44c6c730-0a48-4d37-8094-fa564be0e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.592069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:54.906840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:54.908709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:54.921804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cd6f5-535c-4f29-bae2-84ee26dd3bc8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:54.925362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:54.925953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:54.926228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:54.926500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:54.936101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:54.937581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa0875-07b6-4426-8510-0faef6944c50 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:54.948471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 771/1539] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:04.576137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=70 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:04.943191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=33 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:30.208892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd0f0-8253-44c7-bfbf-3932db78f264 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.210000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd0f0-8253-44c7-bfbf-3932db78f264 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.210000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd0f0-8253-44c7-bfbf-3932db78f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.238885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6a0bd0f0-8253-44c7-bfbf-3932db78f264 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.240128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6a0bd0f0-8253-44c7-bfbf-3932db78f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.243284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203e188-84a2-4ece-97d9-7136a5adcf8e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.244362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203e188-84a2-4ece-97d9-7136a5adcf8e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.244885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203e188-84a2-4ece-97d9-7136a5adcf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.256324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 769/1540] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.273768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.274144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.274395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.299502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d203e188-84a2-4ece-97d9-7136a5adcf8e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.301196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d203e188-84a2-4ece-97d9-7136a5adcf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.323136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 772/1541] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.325462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.327267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.336718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c183-2484-4e9f-9226-2b7eab9058ff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.337387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c183-2484-4e9f-9226-2b7eab9058ff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.338075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222c183-2484-4e9f-9226-2b7eab9058ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.362005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 770/1542] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.369341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.385455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d222c183-2484-4e9f-9226-2b7eab9058ff None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.387138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402e48b-79ba-4618-8ddf-41b356439c26 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.389162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d222c183-2484-4e9f-9226-2b7eab9058ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.408558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.414149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.416566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.417095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.418022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:30.418270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 773/1543] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:30.418791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.421345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.422562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.423096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.423565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.460632 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 771/1544] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:30.461830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.462052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.463068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.477145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc232ad-ecec-4dea-ab27-7830ee8bd445 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.481973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 774/1545] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.483360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.493468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19cd40-c54a-4c38-b40c-a795e3aa8449 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.507039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fa836-9fab-4095-ba28-c0cab61d6b4c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.512025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.512691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.512978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.513250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.514852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.524425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.527109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 772/1546] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:30.528960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aceb-79d9-4a86-a295-ff33201d468f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.529508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aceb-79d9-4a86-a295-ff33201d468f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.530554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580aceb-79d9-4a86-a295-ff33201d468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.577727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1580aceb-79d9-4a86-a295-ff33201d468f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.579522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1580aceb-79d9-4a86-a295-ff33201d468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.588517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 773/1547] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.590236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.591163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.591670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.614548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.616344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.625541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 774/1548] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.626710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.644442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b392d-1f27-4df5-aa58-4d23fb85dafb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.649836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.651237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.651758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.652374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.653418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.655331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:30.655331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 14:03:30.655331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 14:03:30.657064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb5fea-a419-4588-be72-a9946618f3d0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.690269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 775/1549] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:30.690269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.759726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 775/1550] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:30.761593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.762110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.769389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.781160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74417cd-5f51-42a9-94f2-45926ca9b4aa admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.809680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:30.811523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:30.863160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.863770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.864050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.864361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.865017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:30.865320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.866342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:30.866342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 14:03:30.866342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 14:03:30.867247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.886788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 776/1551] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:30.886788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.892289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 776/1552] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:30.892989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:30.896032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e53f0-157d-4f9c-b52e-bf4b55cf1bb1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.901097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.901677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.902109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.902388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.903023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.903924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d35263-0ea3-4770-93e5-24e0fea4cc70 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:30.904053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:30.904053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 14:03:30.904053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 14:03:30.905777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e6387-4cf2-4246-a757-d87f72c569e4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:30.909403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:30.910009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:30.910289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:30.910702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:30.911450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:30.913536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae96fb0-7565-4cfe-83bc-1c53ded30f25 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.020734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 777/1553] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.022067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8175b-0619-432f-aeb2-f178623c2c4c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.022334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8175b-0619-432f-aeb2-f178623c2c4c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.022614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8175b-0619-432f-aeb2-f178623c2c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.045180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eef8175b-0619-432f-aeb2-f178623c2c4c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.046974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eef8175b-0619-432f-aeb2-f178623c2c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.054658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 777/1554] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:30 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.054658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.054658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.054658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.056017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 778/1555] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.057413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.058021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.058347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.076157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.080612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.080764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.080764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.085612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 778/1556] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.086464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.087542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 779/1557] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.091296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.097621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35d8830-8917-45c9-9347-88d44d59c66b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.102632 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.103256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.103538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.103672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079255f0-7a4d-4057-87e0-c4f796243064 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.103892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.104719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.106660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28db50c-5937-4ca9-b08c-aa0018090619 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.109011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.109617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.109900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.110172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.110820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:31.111126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.113097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d5f8fa-f4a9-4a0e-b404-b2ad46fa1b4d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.125713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 780/1558] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:31.127111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.127388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.127666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.147761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.149076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.158327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 781/1559] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.159241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.169917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71c855-6358-4169-8f74-06bb4bf7a07f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.175147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.175847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.176151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.176468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.177142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.178718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.181392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:31.191411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 782/1560] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:31.191411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.193498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 779/1561] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.193498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587673f-c64f-45b4-84ae-1087d1331958 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.193498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587673f-c64f-45b4-84ae-1087d1331958 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.193498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587673f-c64f-45b4-84ae-1087d1331958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.203180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588ab8f-cd21-4b02-8d85-7b5fc9757232 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.214678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3587673f-c64f-45b4-84ae-1087d1331958 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.215889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3587673f-c64f-45b4-84ae-1087d1331958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.255664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:31.266533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.267499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.267499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.267983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.268366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.270051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07380fd-b39f-429d-acff-fbf0ef8744fb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.285704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 780/1562] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.285704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.285704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.285704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.291674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 783/1563] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:31.294142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f4e-4900-4425-a9c0-d27c9cd06bee None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.294636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f4e-4900-4425-a9c0-d27c9cd06bee None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.295356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb0f4e-4900-4425-a9c0-d27c9cd06bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.313722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.314975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.323285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 781/1564] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.327711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.327895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-05fb0f4e-4900-4425-a9c0-d27c9cd06bee None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.327895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-05fb0f4e-4900-4425-a9c0-d27c9cd06bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.334208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e96b0e-ff4e-49c2-afaa-2d621bf1a2ea None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.338771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.339413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.339689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.339956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.344971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 784/1565] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.345387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.345387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.345580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.345580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.345580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.379507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:31.381653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:31.397918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 785/1566] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:31.398773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.410747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32064822-1ff6-4e44-a87e-6b89a8bdb430 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.415847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.416499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.416785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.417045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.417727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.419395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.431999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 786/1567] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:31.433212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.448777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68480ab-23ce-4328-9990-b4cf43082a41 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.456702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.457688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.458123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.458560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.459811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.460548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 782/1568] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.461895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.463492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.536573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3db5b-554c-4442-9838-2187e720b44c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.542272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.544724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.544724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.544724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.544724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.546167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.557308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 783/1569] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:31.558183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.571188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a9fb0-e007-4bf9-b2d2-661fedc36a35 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.574368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 787/1570] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/users => generated 302 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.575303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.577751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.579465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.579465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.579465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.579754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:31.580060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.582002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.589166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ddcbf-f850-4844-ab58-6e4320bf3d60 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.595186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.603327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 784/1571] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:31.603533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.603533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.603533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.603846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.603948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:31.603948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.603948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.608903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4293e7f-8239-4246-8c16-abb54307c545 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.614469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 788/1572] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:31.614469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.615038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.615682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.615963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.616261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.616945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:31.617244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.619484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.632171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778228f-bdb7-439d-841b-9755160bb455 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.634043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 785/1573] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:31.637226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.640577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.641268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.641612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.642172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.642634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:31.642934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.646114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.650412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcffeb-041a-455b-9de0-dbd7367255fd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.656351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.657045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.657323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.657596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] PATH_INFO: `/v3/projects/62486ef6f91e470fba8c5d1b51a47c7f/users/88d8e4c77c0b40649e77e0c1c267bee5/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.666413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 789/1574] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:31.666413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.674093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711abecf-2b43-45ef-b2d2-f76b2288bbe3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.679622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.680286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.680571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.680845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.681485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.682211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62486ef6f91e470fba8c5d1b51a47c7f, user_id=88d8e4c77c0b40649e77e0c1c267bee5, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.683291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:31.683291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 14:03:31.683291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 14:03:31.683568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.685284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.810776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 786/1575] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:31 2022] PUT /identity/v3/projects/62486ef6f91e470fba8c5d1b51a47c7f/users/88d8e4c77c0b40649e77e0c1c267bee5/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:31.812035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.862852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 790/1576] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:31.864720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.880491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943924c-0265-42b4-bd15-0c876d692360 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.901631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:31.907394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298a8c-808b-4adc-84d6-e726239c5933 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.912755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.916849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.916849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.916849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] PATH_INFO: `/v3/projects/b6a70f0a10cc4d2abd08aac2c52b4217/users/4a5b8b681436473d9b19f90910a8211c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.936483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a70f0a10cc4d2abd08aac2c52b4217, user_id=4a5b8b681436473d9b19f90910a8211c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.940358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.955864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.956551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.962629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.962629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.962629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.962629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:31.971122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 791/1577] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:31.972179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:31.979042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:31.984375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951b888-7f45-49e1-bede-255eb11a4a72 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:31.990146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:31.990785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:31.991066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:31.991340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:31.991998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:31.994289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.026595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 787/1578] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:31 2022] PUT /identity/v3/projects/b6a70f0a10cc4d2abd08aac2c52b4217/users/4a5b8b681436473d9b19f90910a8211c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:32.028708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.089861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 792/1579] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:31 2022] POST /identity/v3/projects => generated 369 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.090927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.109746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987abe6e-24b2-4d5c-a1ba-82d44bed8e10 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.188876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.189541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.189802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.190077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.190725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.192734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.194702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92552d4-2355-49d2-a8f9-9ad14d5b6b69 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.199655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.202797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.202797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.202797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.202797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.203536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6eef31-519b-4819-ad82-8b840f6753b3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.289204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 788/1580] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/projects => generated 391 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.290227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.327476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 793/1581] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/projects => generated 401 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.327476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.327476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.327476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.357179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] MFA Rules not processed for user `88d8e4c77c0b40649e77e0c1c267bee5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:32.359051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:32.368081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b63e-d745-4358-a010-c74098872a06 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.391963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:32.440278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 794/1582] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:32.441207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.461374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.462064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.462345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.462620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.463266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.465379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6ff80-c50b-474f-89a2-f158d788fcfc admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.532313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:32.536645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2274f98-4a53-46de-a773-2ab331e07aa4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.541487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.542108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.542389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.542666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.543320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.548992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.558394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 795/1583] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:32.559558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.570110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847bd3d-8407-42df-a2e4-7bccdfc2342d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.574363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 789/1584] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/projects => generated 377 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.575270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.575781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.575956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.576109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.576356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.576531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.576744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.577160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.579014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.589757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 796/1585] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:32.595986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.598072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:32.599304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:32.602364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c57ab-c051-446f-8d2a-18630729453c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.674453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.674998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.675193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 790/1586] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:32.675348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.675541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.676145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.676287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.678338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.689613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2014f6-c8c4-43af-b20e-941dcdef8a63 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.694822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.695720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.695720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.695966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.696690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.698631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282cdcbd-4260-48ed-9a0e-3e055c8309e9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.815412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 797/1587] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.817022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.827751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 791/1588] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/users => generated 296 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.830150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547135-8f58-40f8-9785-0bd5482bc3d2 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.830818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547135-8f58-40f8-9785-0bd5482bc3d2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.831465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547135-8f58-40f8-9785-0bd5482bc3d2 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.834111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 792/1589] 10.222.0.96 () {54 vars in 962 bytes} [Thu Sep 8 14:03:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:32.834383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721ff27-3b72-42e1-a87e-e5960179f095 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.835891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547135-8f58-40f8-9785-0bd5482bc3d2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.843240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.844273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.844820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.845251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.846342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.849725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.857608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547135-8f58-40f8-9785-0bd5482bc3d2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.864746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.865522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.870430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.870430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.870430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.870430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.891761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 793/1590] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:32.892817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.903301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e742d-895a-46d8-ba32-41aa46ac871f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.908795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.909416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.909710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.909980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:32.910624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:32.912623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:32.973944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 798/1591] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:32.974811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:32.985636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c5d4-b34d-469e-bab5-57158d042cda admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:32.990839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:32.991517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:32.991797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:32.992068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] PATH_INFO: `/v3/projects/59a80bbf94ae4475875fa1763480fa1e/users/ccefbe42f5c34610b3ad4f2c6cda982c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.009171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a80bbf94ae4475875fa1763480fa1e, user_id=ccefbe42f5c34610b3ad4f2c6cda982c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.012027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376d88-9050-4f47-a5ba-5c73df268865 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.012842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 794/1592] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:32 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:33.013514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.072318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b931a41-e41e-4d91-bb65-d85b697fac2a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.076138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.077362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.078056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.078056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.087451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.088934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.099379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 795/1593] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:33.100222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.104698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.110079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a7fe9f-8b8f-44c7-ab92-5645ab119470 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.114871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033ab-adbb-4106-b843-53151383445f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.115629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033ab-adbb-4106-b843-53151383445f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.115909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033ab-adbb-4106-b843-53151383445f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.116230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667033ab-adbb-4106-b843-53151383445f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.117052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667033ab-adbb-4106-b843-53151383445f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.118879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667033ab-adbb-4106-b843-53151383445f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.129584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 799/1594] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:32 2022] PUT /identity/v3/projects/59a80bbf94ae4475875fa1763480fa1e/users/ccefbe42f5c34610b3ad4f2c6cda982c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:33.140840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 796/1595] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.140840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033ab-adbb-4106-b843-53151383445f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.142691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667033ab-adbb-4106-b843-53151383445f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.142818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.143246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.143520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.189271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:33.190541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:33.213457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.214116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.214443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.214722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.215397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.217224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.227919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 797/1596] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.228812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.239608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dacb2-b04a-4f8d-808b-00dd2d1bc6db admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.244845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.245510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.245811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.246062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] PATH_INFO: `/v3/projects/4db492af84924873b701999627f121d9/users/43f50b6d10f94b8aa55dd3f2f6ea971e/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.263952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db492af84924873b701999627f121d9, user_id=43f50b6d10f94b8aa55dd3f2f6ea971e, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.267831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.279679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 800/1597] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Sep 8 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:33.280585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.290771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7c8b60-c887-400f-80cb-c4b58feff877 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.295627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.296297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.296581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.296877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.297504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.299095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.301430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.309609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 801/1598] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.310417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.320800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c576b914-c809-4ccb-ae01-db447e3fbd13 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.325542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.326134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.326412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.327352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.327988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.329602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581271-bc29-476d-8490-bfa36636e18d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.332103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 798/1599] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:33 2022] PUT /identity/v3/projects/4db492af84924873b701999627f121d9/users/43f50b6d10f94b8aa55dd3f2f6ea971e/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:33.332103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.344468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 802/1600] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.346335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.346883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.347336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.375851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] MFA Rules not processed for user `ccefbe42f5c34610b3ad4f2c6cda982c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:33.377193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:33.400650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3926e-11af-4484-a97d-2dffc137151c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.406749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.406749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.407020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.407295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.408000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.409903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.424095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 799/1601] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.424095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.435020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43572ac6-1eba-46c0-87d7-602dc8fe9774 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.447098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.447098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.447098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.447098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.447735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.447735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.456502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 800/1602] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.457393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.476367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 803/1603] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:33.478343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.496324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826213fa-54d9-4b0e-bc75-0a22b327ae6f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.501952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.502567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.502849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.503143 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.503825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.505526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b267554-032e-4e69-adab-e2cee238f4ee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.514239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.522909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 804/1604] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.524656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.528872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.528872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.540219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ee69f-8732-4a65-bb41-ae9342a639af admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.546678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:33.546938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.547425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.547699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.547970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.548081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:33.556262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 805/1605] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:33.556944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.574720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06f67-221d-4b7b-a481-922733a9db29 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.581063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.581780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.582134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.582537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.583287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.585325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.597602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 806/1606] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:33.598275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.611877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7427-8658-4538-8771-07e43f640bbe admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.619319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.620831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.620831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.620831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] PATH_INFO: `/v3/projects/cfd026864f654065a3401de305e2aa20/users/576ee37425a442b7b7f8c0599a419834/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.627046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.628890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.640356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd026864f654065a3401de305e2aa20, user_id=576ee37425a442b7b7f8c0599a419834, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.643467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 801/1607] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:33.644416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.658900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.667259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec25429-bbdf-4180-b35e-ce59471f1a7f service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.673337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.674983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.674983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.675295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] PATH_INFO: `/v3/projects/4b3060b6875a41ec84e9e0936e710b28/users/4d3f02b889cb44969b170a61388ce05c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.698699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b3060b6875a41ec84e9e0936e710b28, user_id=4d3f02b889cb44969b170a61388ce05c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.701543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.771479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 807/1608] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:33 2022] PUT /identity/v3/projects/cfd026864f654065a3401de305e2aa20/users/576ee37425a442b7b7f8c0599a419834/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:33.771479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.824930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 802/1609] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:33 2022] PUT /identity/v3/projects/4b3060b6875a41ec84e9e0936e710b28/users/4d3f02b889cb44969b170a61388ce05c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:33.829667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:33.835536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e4a3cb-6294-41d8-a376-746616999a27 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.875306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:33.905299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c8c91-2f76-4c70-bb53-050114484807 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:33.910798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.911364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:33.911516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.911770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.912053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] PATH_INFO: `/v3/projects/ffdefc5b1cb344af8b90e37c5743a2f4/users/7afb9e33eb9d427b8dbd10fe81a73750/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.912701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:33.913224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:33.913563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:33.914603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.917633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:33.928374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdefc5b1cb344af8b90e37c5743a2f4, user_id=7afb9e33eb9d427b8dbd10fe81a73750, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:33.931195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.025679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 803/1610] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:33 2022] PUT /identity/v3/projects/ffdefc5b1cb344af8b90e37c5743a2f4/users/7afb9e33eb9d427b8dbd10fe81a73750/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:34.027633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.062629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 808/1611] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:33 2022] POST /identity/v3/projects => generated 403 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:34.063579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.082280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:34.092788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c962a-65aa-4a83-b967-69046cf68e99 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.148568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8d5c5-3e1f-4e1a-ac59-1d59d1bd5ca1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.153997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.155308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.155745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.155936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] PATH_INFO: `/v3/projects/fc96d61e2b6c4af4920b0c7473843ed2/users/3fa1b5ef483e4aa295b29e546a8e18ea/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.165714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.166261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.166511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.167755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.176778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc96d61e2b6c4af4920b0c7473843ed2, user_id=3fa1b5ef483e4aa295b29e546a8e18ea, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.179444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.179755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b120d-a9db-465e-af2e-98a0bdd00931 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.180949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797832ac-3c66-4d5f-ae6e-7c78ee2e9851 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.194389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 804/1612] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:34.195913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c665-dcc3-409c-82d3-97b4c42a1b53 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.196253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c665-dcc3-409c-82d3-97b4c42a1b53 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.196585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42c665-dcc3-409c-82d3-97b4c42a1b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.246995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5b42c665-dcc3-409c-82d3-97b4c42a1b53 None None] MFA Rules not processed for user `576ee37425a442b7b7f8c0599a419834`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:34.248226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5b42c665-dcc3-409c-82d3-97b4c42a1b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.265786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 809/1613] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:34 2022] PUT /identity/v3/projects/fc96d61e2b6c4af4920b0c7473843ed2/users/3fa1b5ef483e4aa295b29e546a8e18ea/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:34.267566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.268878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.268878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.287959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:34.289276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.328760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 805/1614] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:34.330403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ba3b-b535-49a0-a902-ee1521ee479b None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.330861 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ba3b-b535-49a0-a902-ee1521ee479b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.331328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65ba3b-b535-49a0-a902-ee1521ee479b None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.333561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 806/1615] 10.222.0.96 () {54 vars in 912 bytes} [Thu Sep 8 14:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:34.334786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9149-08fd-4202-8ac1-a15ed4cc2452 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.335326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9149-08fd-4202-8ac1-a15ed4cc2452 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.335326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed9149-08fd-4202-8ac1-a15ed4cc2452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.356168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-40ed9149-08fd-4202-8ac1-a15ed4cc2452 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:34.357523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-40ed9149-08fd-4202-8ac1-a15ed4cc2452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.357723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 810/1616] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:34.358469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.370425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 807/1617] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:34.370425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.370719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d74f92-7432-4afa-82c2-58b0371c41ff None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.370807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.370807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.375531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.377966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.377966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.377966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.377966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.379878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20163874-3b9c-4ba6-8585-ea90021a9bc5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.391214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:34.392481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.400801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 808/1618] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:34.401524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.412009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ea558-0515-441f-a6e7-56f58ada2bd0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.416755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.417446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.417628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.417902 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.418537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.422126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.499456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 811/1619] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/users => generated 308 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:34.499456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.499456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.499456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.519884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:34.525794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.539027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 809/1620] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:34.539027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.540908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:34.565924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:34.674728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 812/1621] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:34.675641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:34.706676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff99a34-dc4e-4923-8fb2-0aba089223ec admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.713333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.714729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.715213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.715505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.734622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:34.767720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8cd053-93f3-4177-abda-eb8360e9d220 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:34.773801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:34.774879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:34.775397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:34.775856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:34.837136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:34.839065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:34.860868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 810/1622] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:34.860868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.118262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dacd85-8a49-4c48-a26c-61a07ffe038a service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.118262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.118262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.118262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.126076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.126382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.126382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.127192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.127192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.127959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 813/1623] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:35.127959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.128586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 811/1624] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:35.128586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.129168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1159d-1fb5-423a-bae7-f923f31f04df service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.129168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.129168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.129168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.130188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.130416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c7a3-0d23-46be-9620-edffc1d6a005 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.130555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.130555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.130876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.130876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.130876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.130876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.131389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.131389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.131632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 814/1625] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:35.131632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.131632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07986c-3b01-46ca-a83e-bf65118d4ed9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.131632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.132117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.132117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.132117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.132117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:35.132831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 812/1626] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:34 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:35.132831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.132831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798d9ba-a405-4293-ad1e-a08bb5beb611 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.132831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.133495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.133495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.133495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] PATH_INFO: `/v3/projects/b7708469fdb64457a198c41a4a8fc3c2/users/0985e81b8257458eb0ebb821f6d4e307/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.163025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.164733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.166139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7708469fdb64457a198c41a4a8fc3c2, user_id=0985e81b8257458eb0ebb821f6d4e307, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.169536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.181657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 815/1627] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:35.182828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.203664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601d163-f60e-498c-9dcf-f2e7064c7946 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.210383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.211136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.211594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.211944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.212882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.215927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.234907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 816/1628] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:35.237735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.251603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b92c6b-ac33-4ef5-8ab6-d1a81312220d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.259700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.260497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.266553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.266553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] PATH_INFO: `/v3/projects/05166f4406c744d780c80531cdc38b05/users/1c7d61e631164c2c8d75080b2081b154/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.286620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05166f4406c744d780c80531cdc38b05, user_id=1c7d61e631164c2c8d75080b2081b154, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.290972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.350727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 813/1629] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:35 2022] PUT /identity/v3/projects/b7708469fdb64457a198c41a4a8fc3c2/users/0985e81b8257458eb0ebb821f6d4e307/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:35.358808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.451378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 817/1630] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:35 2022] PUT /identity/v3/projects/05166f4406c744d780c80531cdc38b05/users/1c7d61e631164c2c8d75080b2081b154/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:35.456043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.526011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c126a-b8e5-4695-b69c-003544efce6f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.625452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.626558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.627276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.627773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.628735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.631078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.634137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:35.648060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 814/1631] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:35.654091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.661459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5607c0e-0902-4a56-9c47-466a47cdd0c9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.673590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fe8a-75b9-4079-9140-17b34b3efc06 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.674696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.675332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.675611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.675888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.676632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.678416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.681285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.682071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.682459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.682860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] PATH_INFO: `/v3/projects/b7708469fdb64457a198c41a4a8fc3c2/users/0985e81b8257458eb0ebb821f6d4e307/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.685650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7708469fdb64457a198c41a4a8fc3c2, user_id=0985e81b8257458eb0ebb821f6d4e307, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.688871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d24d0c-c6a1-4c72-b653-feb7da727f7a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.704419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 818/1632] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:35.705404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.708717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 815/1633] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:35 2022] PUT /identity/v3/projects/b7708469fdb64457a198c41a4a8fc3c2/users/0985e81b8257458eb0ebb821f6d4e307/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:35.722764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d2b2d-98a3-4ac0-8e6b-4c9cf3d30bcd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:35.725221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.725635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.726222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.767915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] MFA Rules not processed for user `0985e81b8257458eb0ebb821f6d4e307`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:35.770110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:35.796299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:35.805587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:35.807388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.813256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.813256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] PATH_INFO: `/v3/projects/05166f4406c744d780c80531cdc38b05/users/1c7d61e631164c2c8d75080b2081b154/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.813256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05166f4406c744d780c80531cdc38b05, user_id=1c7d61e631164c2c8d75080b2081b154, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:35.814163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d328dcf8-033e-4dc6-a32b-80c93c1df6b6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:35.830183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 819/1634] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:35 2022] PUT /identity/v3/projects/05166f4406c744d780c80531cdc38b05/users/1c7d61e631164c2c8d75080b2081b154/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:35.842028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:35.842889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:35.843309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:35.879615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] MFA Rules not processed for user `1c7d61e631164c2c8d75080b2081b154`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:35.881105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:35.976021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 816/1635] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:35.986880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:35.997658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 820/1636] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:36.072541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f3e4f-cb19-4cc5-a56f-bc345b27b10c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:36.187985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:36.188593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:36.188868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:36.189137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:36.308450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:36.312237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:36.346261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 817/1637] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:36.421102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:36.433356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8329f05-7643-4a7a-a386-d32faa0c789b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:36.473063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:36.473063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:36.473063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:36.473063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:36.501963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:36.503556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:36.546449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 821/1638] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:36.627917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:36.818472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:36.948279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:36.985431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19239-0e4e-42f5-b2a7-7ca0f310eb9f service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:36.992197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1465b-3aa3-4327-8e94-dc26ef744c7c service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:36.995378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:36.999759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:36.999759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.000182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.022462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:37.023143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.023428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.023708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] PATH_INFO: `/v3/users/ccefbe42f5c34610b3ad4f2c6cda982c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.025792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccefbe42f5c34610b3ad4f2c6cda982c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:37.026852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: WARNING py.warnings [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:37.026852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: warnings.warn(msg) Sep 08 14:03:37.026852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: Sep 08 14:03:37.028178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:37.175139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:37.177851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6c430-d722-4de5-87a5-ad01f70d163e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:37.202700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 822/1639] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:37.204094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a29a9-211b-458d-a30d-50afae08b6cf None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.214599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a29a9-211b-458d-a30d-50afae08b6cf None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.214599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a29a9-211b-458d-a30d-50afae08b6cf None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.215709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 823/1640] 10.222.0.96 () {54 vars in 962 bytes} [Thu Sep 8 14:03:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:37.221471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58bdf-d22f-49fb-823f-73e8ccb34a3a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.221760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58bdf-d22f-49fb-823f-73e8ccb34a3a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.222046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e58bdf-d22f-49fb-823f-73e8ccb34a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.286736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c3e58bdf-d22f-49fb-823f-73e8ccb34a3a None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:37.290305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c3e58bdf-d22f-49fb-823f-73e8ccb34a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:37.412692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:37.439976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 824/1641] 10.222.0.96 () {58 vars in 1059 bytes} [Thu Sep 8 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:37.446326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709c30-ca41-481e-ad0f-dfc84aeb58ac None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.446949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709c30-ca41-481e-ad0f-dfc84aeb58ac None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.447438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22709c30-ca41-481e-ad0f-dfc84aeb58ac None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.462629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccefbe42f5c34610b3ad4f2c6cda982c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:37.464754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 825/1642] 10.222.0.96 () {54 vars in 912 bytes} [Thu Sep 8 14:03:37 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:03:37.472740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.473170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.473745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.506612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:37.508364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:37.514192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccefbe42f5c34610b3ad4f2c6cda982c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:37.515717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccefbe42f5c34610b3ad4f2c6cda982c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:37.522366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 826/1643] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:37.532406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccefbe42f5c34610b3ad4f2c6cda982c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:37.536594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:37.539073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:37.556447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a834b5-f433-465b-b02a-675e0e45af90 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:37.563740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:37.564928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.565351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.565625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.586940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:37.588775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada5358-fde2-4832-9193-3db4d38ae998 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:37.605699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 827/1644] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:37.635300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccefbe42f5c34610b3ad4f2c6cda982c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:37.649375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 818/1645] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:36 2022] DELETE /identity/v3/users/ccefbe42f5c34610b3ad4f2c6cda982c => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:37.651652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607c02-4b7d-46fa-b15e-beb0ba034a36 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:37.652307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607c02-4b7d-46fa-b15e-beb0ba034a36 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:37.660879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e607c02-4b7d-46fa-b15e-beb0ba034a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:37.694007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5e607c02-4b7d-46fa-b15e-beb0ba034a36 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:37.696723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5e607c02-4b7d-46fa-b15e-beb0ba034a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:37.805079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 828/1646] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:37.887950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:37.890343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:38.007416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210e4bb-bbf6-457d-8fec-6b8ce69191cf admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:38.013092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:38.013895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:38.015056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:38.015931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:38.028295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:38.030619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:38.045867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 819/1647] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:38.381679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:38.382072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:38.382483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:38.416716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] MFA Rules not processed for user `7afb9e33eb9d427b8dbd10fe81a73750`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:38.417949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:38.594570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 829/1648] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:38.600144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:38.603597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:38.622170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:38.634240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d704a9-c092-4d8b-8b5f-d6b3d6d728c2 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:38.644599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:38.646771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:38.647541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:38.648588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:38.650094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:38.654472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:38.802889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 820/1649] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:38 2022] POST /identity/v3/projects => generated 405 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:38.805773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:38.882159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a19964-ddfb-48f9-b465-505ff1bb3a0a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:39.145517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:39.146451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:39.146757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:39.147023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:39.147624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:39.153121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:39.328368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:39.336856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 830/1650] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:38 2022] POST /identity/v3/users => generated 309 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:39.344142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:39.347745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76669321-a0f4-40bb-91f6-6a334f7111ef admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:39.386074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:39.386788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:39.387071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:39.387347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:39.394188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:39.399498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:39.442510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 821/1651] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:03:39.448798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:39.492299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37eab4-698e-4d29-8e01-facdb54c4cf7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:39.523291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:39.525064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:39.525336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:39.525618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] PATH_INFO: `/v3/projects/148c972481ca47eba30f16f1635b3863/users/4d24d4ff0d844c758f07f0bb96942de6/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:39.567359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148c972481ca47eba30f16f1635b3863, user_id=4d24d4ff0d844c758f07f0bb96942de6, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:39.570244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:39.691410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 831/1652] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:39 2022] PUT /identity/v3/projects/148c972481ca47eba30f16f1635b3863/users/4d24d4ff0d844c758f07f0bb96942de6/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:39.692262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:39.709360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f93d9-b34e-4b02-b988-54a4303d7c3e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:39.867112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:39.867774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:39.868044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:39.868763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:39.869982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:39.871754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:39.890001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 822/1653] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:39.896768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:39.935379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c8afa-ccba-4139-a05e-9450173fb323 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:39.948269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:39.948969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:39.949248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:39.949522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] PATH_INFO: `/v3/projects/148c972481ca47eba30f16f1635b3863/users/4d24d4ff0d844c758f07f0bb96942de6/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:39.951806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] RBAC: Authorizing `identity:create_grant(project_id=148c972481ca47eba30f16f1635b3863, user_id=4d24d4ff0d844c758f07f0bb96942de6, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:39.955264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:39.985203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 832/1654] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:39 2022] PUT /identity/v3/projects/148c972481ca47eba30f16f1635b3863/users/4d24d4ff0d844c758f07f0bb96942de6/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:40.942238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:40.942238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:40.967929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6b4e0-adf9-44bb-85e7-f04ab780ed57 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:41.192589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:41.193617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:41.194036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:41.194879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] PATH_INFO: `/v3/projects/59a80bbf94ae4475875fa1763480fa1e` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:41.199829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a80bbf94ae4475875fa1763480fa1e)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:41.202252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:41.202790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:41.205008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:41.257455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c630921-a935-4165-9cf0-29566074a83a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:41.264985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:41.265650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:41.265951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:41.266199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] PATH_INFO: `/v3/users/88d8e4c77c0b40649e77e0c1c267bee5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:41.269821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d8e4c77c0b40649e77e0c1c267bee5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:41.285823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:41.434226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a80bbf94ae4475875fa1763480fa1e', 'request_id': 'req-d3443601-3b43-4048-8dac-cc4785cc8943'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.454635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a80bbf94ae4475875fa1763480fa1e', 'request_id': 'req-d3443601-3b43-4048-8dac-cc4785cc8943'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.469155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a80bbf94ae4475875fa1763480fa1e', 'request_id': 'req-d3443601-3b43-4048-8dac-cc4785cc8943'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.471850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:41.619254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d8e4c77c0b40649e77e0c1c267bee5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.622313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] The token cache is being invalidate because project 59a80bbf94ae4475875fa1763480fa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:03:41.622750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.624691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.627223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 823/1655] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:03:40 2022] DELETE /identity/v3/projects/59a80bbf94ae4475875fa1763480fa1e => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:41.631395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:41.634115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:41.704458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d8e4c77c0b40649e77e0c1c267bee5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.728631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d8e4c77c0b40649e77e0c1c267bee5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.730646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d8e4c77c0b40649e77e0c1c267bee5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.751715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64096ef0-fcac-4873-ac46-35b1e1fea0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d8e4c77c0b40649e77e0c1c267bee5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:41.773876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 833/1656] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:41 2022] DELETE /identity/v3/users/88d8e4c77c0b40649e77e0c1c267bee5 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:41.778951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:41.779383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:41.781431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:41.790915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3443601-3b43-4048-8dac-cc4785cc8943 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:41.850352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:41.851710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:41.961811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:41.962183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:41.962318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:41.962603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] PATH_INFO: `/v3/users/0985e81b8257458eb0ebb821f6d4e307` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:41.973138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0985e81b8257458eb0ebb821f6d4e307)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:41.975151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:42.056993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 834/1657] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:42.149717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:42.152836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:42.232555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:42.343310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb5ee1-4afa-4a3f-bcb9-62454c43297a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:42.343310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:42.343310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:42.343310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:42.343810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:42.343810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:42.343810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:42.389011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 835/1658] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:42.452995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0985e81b8257458eb0ebb821f6d4e307'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:42.496827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0985e81b8257458eb0ebb821f6d4e307'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:42.498052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0985e81b8257458eb0ebb821f6d4e307'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:42.516045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0985e81b8257458eb0ebb821f6d4e307'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:42.633557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0985e81b8257458eb0ebb821f6d4e307'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:42.641535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 824/1659] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:41 2022] DELETE /identity/v3/users/0985e81b8257458eb0ebb821f6d4e307 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:44.215474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:44.216969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:44.239229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3b8aa-50c3-4285-b9dd-f1006990320c service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:44.359893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:44.361346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:44.361809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:44.362229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] PATH_INFO: `/v3/projects/b7708469fdb64457a198c41a4a8fc3c2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:44.364007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7708469fdb64457a198c41a4a8fc3c2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:44.365688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: WARNING py.warnings [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 14:03:44.365688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: warnings.warn(msg) Sep 08 14:03:44.365688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: Sep 08 14:03:44.370290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:44.633597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7708469fdb64457a198c41a4a8fc3c2', 'request_id': 'req-e24d3630-335b-4614-b228-b2456e0abff5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:44.701592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:44.703238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:44.715997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7708469fdb64457a198c41a4a8fc3c2', 'request_id': 'req-e24d3630-335b-4614-b228-b2456e0abff5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:44.727317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7708469fdb64457a198c41a4a8fc3c2', 'request_id': 'req-e24d3630-335b-4614-b228-b2456e0abff5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:44.743337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84871e-1635-4a65-a9cc-8626d4b2dfc1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:44.793980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:44.794743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] The token cache is being invalidate because project b7708469fdb64457a198c41a4a8fc3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:03:44.795054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:44.795821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e24d3630-335b-4614-b228-b2456e0abff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:44.798619 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 836/1660] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:03:44 2022] DELETE /identity/v3/projects/b7708469fdb64457a198c41a4a8fc3c2 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:44.805708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea9a6-7181-4f2a-82e3-a73d5543ac1b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:44.805708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea9a6-7181-4f2a-82e3-a73d5543ac1b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:44.805965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ea9a6-7181-4f2a-82e3-a73d5543ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:44.864282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bf6ea9a6-7181-4f2a-82e3-a73d5543ac1b None None] MFA Rules not processed for user `4d24d4ff0d844c758f07f0bb96942de6`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:44.866392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bf6ea9a6-7181-4f2a-82e3-a73d5543ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:44.934074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:44.934741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:44.935029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:44.935307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] PATH_INFO: `/v3/projects/62486ef6f91e470fba8c5d1b51a47c7f` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:44.939401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62486ef6f91e470fba8c5d1b51a47c7f)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:44.941309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:44.984163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:45.031417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 837/1661] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:45.034829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433de9-5aa7-485c-a6bf-9ad7f4dab744 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.034829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433de9-5aa7-485c-a6bf-9ad7f4dab744 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.034829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de433de9-5aa7-485c-a6bf-9ad7f4dab744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.085294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-de433de9-5aa7-485c-a6bf-9ad7f4dab744 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:45.086907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-de433de9-5aa7-485c-a6bf-9ad7f4dab744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:45.113641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 838/1662] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:45.122328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.122615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.122894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.137811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62486ef6f91e470fba8c5d1b51a47c7f', 'request_id': 'req-9b33ecff-880d-4085-b763-a1fdebe02329'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:45.162830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62486ef6f91e470fba8c5d1b51a47c7f', 'request_id': 'req-9b33ecff-880d-4085-b763-a1fdebe02329'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:45.181473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62486ef6f91e470fba8c5d1b51a47c7f', 'request_id': 'req-9b33ecff-880d-4085-b763-a1fdebe02329'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:45.189776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:45.194085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:45.282548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] The token cache is being invalidate because project 62486ef6f91e470fba8c5d1b51a47c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:03:45.282746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:45.285419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9b33ecff-880d-4085-b763-a1fdebe02329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:45.288132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 825/1663] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:03:44 2022] DELETE /identity/v3/projects/62486ef6f91e470fba8c5d1b51a47c7f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:45.293293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a8c3-b4f6-4183-a87e-611d54213958 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.293581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a8c3-b4f6-4183-a87e-611d54213958 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.293859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2a8c3-b4f6-4183-a87e-611d54213958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.361243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 839/1664] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:45.365292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.370190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-03b2a8c3-b4f6-4183-a87e-611d54213958 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:45.371900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-03b2a8c3-b4f6-4183-a87e-611d54213958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:45.377096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9edac-1bb3-4d11-8c85-532dd260ae29 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:45.382598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:45.383519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.384108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.384710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.386161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:45.386930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:45.389264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:45.397431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 826/1665] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:45.398917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.399209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.399487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.406179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 840/1666] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:45.411345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.449509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:45.452431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:45.460003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c9ca3a-290b-4c08-ab1f-410b66804f94 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:45.473749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:45.474375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.477682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.477682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.477999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:45.478490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 827/1667] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:45.479577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.481561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:45.507133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a15aa-4fcd-469f-bc17-190b2caf4159 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:45.517098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:45.518006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.518426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.518838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.519694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:45.520151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:45.524357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:45.567668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 828/1668] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:03:45.568763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.591934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe5764-e774-4246-90bd-0f6b87a98640 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:45.603271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:45.603913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:45.604228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:45.604503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:45.605158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:45.607711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:45.665383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 841/1669] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:45.668816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.814220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 829/1670] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/projects => generated 393 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:45.817320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:45.846732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200cdff-beae-4c69-9e0f-16b9ee89d3c1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.011527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.012175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.012485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.014743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.014967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.019121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.024276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605b9ec-f8bf-49c3-809a-ce6d83bfb2d0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.043676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.044192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.044518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.044788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.048543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.058611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.188976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 842/1671] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/users => generated 293 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:46.197322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.221112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 830/1672] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:45 2022] POST /identity/v3/users => generated 297 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:46.225310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.225541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9c0cb-0b78-4e13-ac38-58e8fdd9e591 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.242576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.245683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.245683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.245683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.245683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.248373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.249303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9d7b7-1567-4dd7-9bde-d6aa69be9ad6 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.265104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.265926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.266440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.267044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.268629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.273921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.291100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 843/1673] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:03:46.292767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.307940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 831/1674] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:03:46.312733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.321960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ee7cd-96eb-4cee-8241-96c6dee5a7d3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.328078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.328828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.329494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.329974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.330846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.333032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.346376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416c390-4a8e-4e15-9e7b-294a2052131e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.347982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 844/1675] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:46.351940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.364860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fd013-413f-4d80-8d0e-6b6a2d90e376 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.369059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.376892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.376892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.376892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.377169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.377263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.377330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.377330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.377330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] PATH_INFO: `/v3/projects/ef690849f0fe4914a8edd39c09d9479d/users/b83b67fafa17489685fc76a65cd4b603/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.377500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.395321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef690849f0fe4914a8edd39c09d9479d, user_id=b83b67fafa17489685fc76a65cd4b603, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.399170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68802135-4102-4553-85ee-1f427246b8a8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.413683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 832/1676] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:46.421861 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.448509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd9dda-a949-4847-b6ce-23e027623ddb admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.464149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.465165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.465597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.466192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] PATH_INFO: `/v3/projects/697dd78c87e142f388792a42a4b99abc/users/b8b98856b3974250ba14b95329986415/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.499312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 845/1677] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:46 2022] PUT /identity/v3/projects/ef690849f0fe4914a8edd39c09d9479d/users/b83b67fafa17489685fc76a65cd4b603/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:46.510049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.510342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.510595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.511540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697dd78c87e142f388792a42a4b99abc, user_id=b8b98856b3974250ba14b95329986415, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.516301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f93107-3506-4b31-bbe6-77d207de9411 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.552016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] MFA Rules not processed for user `b83b67fafa17489685fc76a65cd4b603`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:46.553465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:46.573105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:46.607188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 833/1678] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:46 2022] PUT /identity/v3/projects/697dd78c87e142f388792a42a4b99abc/users/b8b98856b3974250ba14b95329986415/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:46.609256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.609661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.610014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.636443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:46.649685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] MFA Rules not processed for user `b8b98856b3974250ba14b95329986415`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:46.651107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:46.738677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 846/1679] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:46.742911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.821235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 834/1680] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:46.823233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:46.878138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80602c-00d8-41c9-bec6-b413eded7455 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.967304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a20ff-75f6-4996-bfa4-d192210f2b51 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:46.969280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.972189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.972871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.973347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.974566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.978274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:46.978919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:46.979199 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:46.979472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:46.980126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:46.981327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:46.982150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.127905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 847/1681] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:46 2022] POST /identity/v3/projects => generated 385 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:47.132723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.147649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 835/1682] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:46 2022] POST /identity/v3/projects => generated 393 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:47.149067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.281449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450206-0226-4c24-97b1-1e1e0dcaaee7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.298161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.299097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.299560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.300007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.301001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.303178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.305618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaef60-5bdc-474a-a0e2-a01346dfa964 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.322130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.322876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.323165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.323442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.324193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.329246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.450373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 848/1683] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:47 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:47.454548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.466319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 836/1684] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:47 2022] POST /identity/v3/users => generated 303 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:03:47.468507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.480677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0f7ea-5481-49b0-ae8c-b74fd8b58462 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.489212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198a477-d662-41bc-ade5-beb078a8af0d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.498669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.499663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.502308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.503511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.508452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.508611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.508713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.508713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.508713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.508713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.509094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.510004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.530658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 837/1685] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:47.531907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.546324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e4779-7855-4dad-a7a1-b251e74e4aff admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.553931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 849/1686] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:47.555732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.556461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.556673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.557071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.557474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] PATH_INFO: `/v3/projects/bf4868b52c2d4697a673e500c22d5e0b/users/4f54267d8a5b46d78b0cc7e1caf995fa/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.587140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42232d-ccef-423b-a183-2dc40bb6033f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.600924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.601674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.601952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.602231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.602909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.603378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4868b52c2d4697a673e500c22d5e0b, user_id=4f54267d8a5b46d78b0cc7e1caf995fa, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.604812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.613776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.633327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 850/1687] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:47.637131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.665468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:47.682820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8d76-8edf-4201-94f5-a73f587cccaf admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.721841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:47.721841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.721841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.726520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] PATH_INFO: `/v3/projects/62fef83617e944a0bc6c051e0a83e55e/users/e915d48b231b4695945186c33b2ca4fc/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.745315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 838/1688] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:47 2022] PUT /identity/v3/projects/bf4868b52c2d4697a673e500c22d5e0b/users/4f54267d8a5b46d78b0cc7e1caf995fa/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:47.746497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:47.823133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fef83617e944a0bc6c051e0a83e55e, user_id=e915d48b231b4695945186c33b2ca4fc, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:47.842593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c576893-5f36-44a1-8092-679b2099f946 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:47.953571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b3ff-54d5-425c-85f4-c7987fbd683a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:47.978290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 851/1689] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:47 2022] PUT /identity/v3/projects/62fef83617e944a0bc6c051e0a83e55e/users/e915d48b231b4695945186c33b2ca4fc/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:03:47.980919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3c5e-5787-4d9c-b713-b78c28a63c41 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:47.981431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3c5e-5787-4d9c-b713-b78c28a63c41 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:47.981923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3c5e-5787-4d9c-b713-b78c28a63c41 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:47.990253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 852/1690] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:03:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:48.000469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.000469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.000469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.090476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] MFA Rules not processed for user `e915d48b231b4695945186c33b2ca4fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:48.092262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:48.149548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:48.150341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.150706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.151509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.152246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:48.157248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85e2dc-fb2a-4c38-ba5a-deeac501a045 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:48.177591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 839/1691] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:48.188627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8aac-3bc4-4ea3-abb8-dc9855609ff4 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.191011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8aac-3bc4-4ea3-abb8-dc9855609ff4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.191341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8aac-3bc4-4ea3-abb8-dc9855609ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.240109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-00ab8aac-3bc4-4ea3-abb8-dc9855609ff4 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:48.242566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-00ab8aac-3bc4-4ea3-abb8-dc9855609ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:48.277826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:48.319573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 853/1692] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:48.321511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:48.376271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fbec8-0e17-40ba-b2ef-540f9cd8a338 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:48.398244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:48.400954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.401977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.402436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] PATH_INFO: `/v3/projects/bf4868b52c2d4697a673e500c22d5e0b/users/4f54267d8a5b46d78b0cc7e1caf995fa/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.412408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4868b52c2d4697a673e500c22d5e0b, user_id=4f54267d8a5b46d78b0cc7e1caf995fa, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:48.420788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:48.487945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 854/1693] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:48 2022] PUT /identity/v3/projects/bf4868b52c2d4697a673e500c22d5e0b/users/4f54267d8a5b46d78b0cc7e1caf995fa/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:48.489105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:48.503387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 840/1694] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:48.507327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.528752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.529041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.669787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] MFA Rules not processed for user `4f54267d8a5b46d78b0cc7e1caf995fa`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:48.671834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:48.723282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94462f10-8501-4d57-8ad8-197962a96cdb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:48.729587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:48.733883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.733883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.733883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.733883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:48.737340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8cc8f0-1514-4ece-8aa7-62a6a8c80714 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:48.859312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:48.905473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 855/1695] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:48 2022] POST /identity/v3/projects => generated 387 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:48.920700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:48.921614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:48.921902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:48.978471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 841/1696] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:48.985745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:48.990579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] MFA Rules not processed for user `4a5b8b681436473d9b19f90910a8211c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:48.994132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:48.995170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:49.228050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 856/1697] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:49.229385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:49.349135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd403296-ede3-4283-a8fd-dd49e2c7b34e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:49.378853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec47cd-898b-4b57-b527-9e90451ab490 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:49.386573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:49.387729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:49.388287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:49.388715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:49.390986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:49.393284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:49.429084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:49.519080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 857/1698] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:49 2022] POST /identity/v3/users => generated 300 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:49.519080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:49.526119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:49.555283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:49.557784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:49.558073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:49.559308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:49.590414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:49.598851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:49.629385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 842/1699] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:49.630631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:49.638360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:49.723071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e5607-60af-4db8-b0f0-a6717edd4955 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:49.736928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:49.739302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:49.739633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:49.739912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:49.882919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c73ce-ed84-4665-ac07-1aac6d5c0172 service placement] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:49.898389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:49.900787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:49.902276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:49.902276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:49.932845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:49.940690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:49.953550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:49.955545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:49.973680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 843/1700] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:49.974881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:49.987207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 858/1701] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:49 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:49.995416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccf3ff-872c-442b-b1b2-7961543750f1 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:50.003141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:50.006219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.006219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.006219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.006219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:50.006753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:50.030330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 844/1702] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:50.035941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:50.053016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28213eb-2ee1-4253-9283-bc05a3af1d61 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:50.063932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:50.064445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.064730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.065017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] PATH_INFO: `/v3/projects/b622ae3f6d544170b1ff2731f7119f36/users/d19c8d49a9504be8b2526b150a204286/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.123065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b622ae3f6d544170b1ff2731f7119f36, user_id=d19c8d49a9504be8b2526b150a204286, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:50.125913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:50.207332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:50.228606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c3242-e0f8-4b56-bbb0-e20cc992cdc0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:50.247320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:50.248190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.254492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.262770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 859/1703] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:50 2022] PUT /identity/v3/projects/b622ae3f6d544170b1ff2731f7119f36/users/d19c8d49a9504be8b2526b150a204286/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:50.265086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.267833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:50.405252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee80c39-0b6a-4374-89c8-3dc84a0721c6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:50.413953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:50.415043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.415563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.416076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.417230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:50.419502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:50.459412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:50.465422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 860/1704] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:50.467731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:50.476598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:50.478246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651acf9-156f-4cb1-9b7f-165caa360313 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:50.481755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492313-4a82-4e0b-aaa1-11efb44a7796 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:50.500305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 845/1705] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:50.515017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:50.516453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.516934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.518919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] PATH_INFO: `/v3/projects/b622ae3f6d544170b1ff2731f7119f36/users/d19c8d49a9504be8b2526b150a204286/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.529924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b622ae3f6d544170b1ff2731f7119f36, user_id=d19c8d49a9504be8b2526b150a204286, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:50.539646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:50.575030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:50.575223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:50.575472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:50.576106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 861/1706] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:50 2022] PUT /identity/v3/projects/b622ae3f6d544170b1ff2731f7119f36/users/d19c8d49a9504be8b2526b150a204286/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:50.682281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] MFA Rules not processed for user `d19c8d49a9504be8b2526b150a204286`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:50.684743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:51.047181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 846/1707] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:51.087721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:51.090324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:51.125180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:51.126662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:51.265057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:51.273507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea059a-ab7b-4aba-83f2-f5c3aaead82e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:51.298193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:51.298857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:51.299312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:51.299768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:51.318948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:51.320490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e084b-a5e2-498b-a5b4-7f3416f11c0e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:51.327437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb10f6-0825-4597-92e8-80f878d29bee None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:51.340996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 862/1708] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:51.354330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:51.358219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:51.359553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:51.360958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] PATH_INFO: `/v3/users/7afb9e33eb9d427b8dbd10fe81a73750` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:51.363407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afb9e33eb9d427b8dbd10fe81a73750)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:51.372172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:51.610189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afb9e33eb9d427b8dbd10fe81a73750'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:51.643007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afb9e33eb9d427b8dbd10fe81a73750'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:51.647031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afb9e33eb9d427b8dbd10fe81a73750'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:51.661823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afb9e33eb9d427b8dbd10fe81a73750'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:51.789297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c3763242-f4e4-4a2c-b5bc-9e7fea20db6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afb9e33eb9d427b8dbd10fe81a73750'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:51.811214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 847/1709] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:51 2022] DELETE /identity/v3/users/7afb9e33eb9d427b8dbd10fe81a73750 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:03:52.114219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.174022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.325480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73714-7849-4405-837b-a5ca87340988 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:52.325935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73714-7849-4405-837b-a5ca87340988 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:52.326025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73714-7849-4405-837b-a5ca87340988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:52.390512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cab73714-7849-4405-837b-a5ca87340988 None None] MFA Rules not processed for user `4d3f02b889cb44969b170a61388ce05c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:52.391970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cab73714-7849-4405-837b-a5ca87340988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:52.547131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:52.548064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:52.549101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:52.596401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 863/1710] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:52.607419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:52.608350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:52.608803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:52.642148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] MFA Rules not processed for user `43f50b6d10f94b8aa55dd3f2f6ea971e`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:52.644786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:52.662335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] MFA Rules not processed for user `4d3f02b889cb44969b170a61388ce05c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:52.662335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:52.674850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 864/1711] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:52.689370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:52.691293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:52.830406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 848/1712] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:52.833671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:52.840067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:52.908468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcf815-d5db-43ad-a71b-b8929658b2db None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:52.922965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:52.926262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:52.927190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:52.927841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] PATH_INFO: `/v3/projects/ffdefc5b1cb344af8b90e37c5743a2f4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:52.929311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.934780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdefc5b1cb344af8b90e37c5743a2f4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:52.938524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:53.086263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299da48-66ce-4288-87e1-d59dca9985ed None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:53.101798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:53.103636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:53.103929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:53.108747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:53.122241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:53.125885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:53.148879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 849/1713] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:53.149793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:53.154279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:53.168845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdefc5b1cb344af8b90e37c5743a2f4', 'request_id': 'req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:53.210995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e247006-203f-45eb-8d6b-cf18e072f58e service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:53.323232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdefc5b1cb344af8b90e37c5743a2f4', 'request_id': 'req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:53.331807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdefc5b1cb344af8b90e37c5743a2f4', 'request_id': 'req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:53.372103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] The token cache is being invalidate because project ffdefc5b1cb344af8b90e37c5743a2f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:03:53.372103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:53.387030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:53.400734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 865/1714] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:03:52 2022] DELETE /identity/v3/projects/ffdefc5b1cb344af8b90e37c5743a2f4 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:53.415368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:53.419741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:53.535909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:53.540465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:53.540887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:53.541082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:53.557983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:53.658675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b229a0-3d5e-4f32-9d65-ff2e110cec3a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:53.682999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:53.684565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:53.692368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:53.693640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] PATH_INFO: `/v3/users/4d24d4ff0d844c758f07f0bb96942de6` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:53.701630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d24d4ff0d844c758f07f0bb96942de6)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:53.710457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:53.832872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:53.835893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:53.877188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 850/1715] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:53.908807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:54.004353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d24d4ff0d844c758f07f0bb96942de6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:54.058544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:54.060641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:54.103783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d24d4ff0d844c758f07f0bb96942de6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:54.127864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d24d4ff0d844c758f07f0bb96942de6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:54.136773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d24d4ff0d844c758f07f0bb96942de6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:54.151957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f05baf1-9b00-46f7-b641-e8be98b8e6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d24d4ff0d844c758f07f0bb96942de6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:54.168946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 866/1716] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:53 2022] DELETE /identity/v3/users/4d24d4ff0d844c758f07f0bb96942de6 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:54.189548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba4ec-ee5d-4664-8ade-8fde16e531eb service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:54.346830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:54.347478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:54.347773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:54.348053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:54.361462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:54.551573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:54.553255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec6ee6-2c5a-4881-bd7f-b7367c6b7a3a service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:54.576465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 851/1717] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:03:54.874888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:55.132580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6533d-e155-48bb-82e6-f06a195f5c5f None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.133078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6533d-e155-48bb-82e6-f06a195f5c5f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.133152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6533d-e155-48bb-82e6-f06a195f5c5f None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.134928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 867/1718] 10.222.0.96 () {54 vars in 912 bytes} [Thu Sep 8 14:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:55.148317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fed3c-e72b-4f9d-8f5b-9ced764db773 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.148613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fed3c-e72b-4f9d-8f5b-9ced764db773 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.148995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fed3c-e72b-4f9d-8f5b-9ced764db773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.167913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.168481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.168907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.274333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-026fed3c-e72b-4f9d-8f5b-9ced764db773 None None] MFA Rules not processed for user `3fa1b5ef483e4aa295b29e546a8e18ea`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:55.279385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-026fed3c-e72b-4f9d-8f5b-9ced764db773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.323720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:55.329115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.352351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:55.538624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 852/1719] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:55.541609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.541904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.542281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.549771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 868/1720] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:55.574635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:55.581279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.616725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5498c1-b7bc-4099-aaed-83f2ff26774f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:55.629395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] MFA Rules not processed for user `3fa1b5ef483e4aa295b29e546a8e18ea`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:55.633137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.654800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:55.656026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.656344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.656623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.659159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 853/1721] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:55.661083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:55.669230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.693235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:55.698692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:55.700273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:55.736526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 869/1722] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:55.739229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:55.741431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:55.843254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb1d2b-48e3-43a2-8966-a82ca6fd4d02 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:55.850683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:55.852663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.853188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.853699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] PATH_INFO: `/v3/projects/148c972481ca47eba30f16f1635b3863` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.856925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=148c972481ca47eba30f16f1635b3863)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:55.860827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:55.906568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e976102-1540-4767-9e41-c71d23cdd97d service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:55.916460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:55.917509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:55.918007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:55.919925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:55.932313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:55.935937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142115fc-3e6f-429d-b578-033682972dfa service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:55.951314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 870/1723] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:56.133822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148c972481ca47eba30f16f1635b3863', 'request_id': 'req-65df3670-9fd4-42e8-bd29-337fe90a40cf'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:56.163750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148c972481ca47eba30f16f1635b3863', 'request_id': 'req-65df3670-9fd4-42e8-bd29-337fe90a40cf'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:56.192000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148c972481ca47eba30f16f1635b3863', 'request_id': 'req-65df3670-9fd4-42e8-bd29-337fe90a40cf'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:56.305527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] The token cache is being invalidate because project 148c972481ca47eba30f16f1635b3863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:03:56.308691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:56.309535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-65df3670-9fd4-42e8-bd29-337fe90a40cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:56.315502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 854/1724] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:03:55 2022] DELETE /identity/v3/projects/148c972481ca47eba30f16f1635b3863 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:56.322744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.324788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.325356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.376617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:56.381764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:56.509815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 871/1725] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:56.526837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.527611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.528381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.590132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:56.591410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:56.628464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 855/1726] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:56.630853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:56.662151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6353c1e5-e82f-4385-a371-91f055b2d91a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:56.670165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:56.671902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.672215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.672512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.682528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:03:56.683237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:56.695340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:56.745315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 872/1727] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:03:56.751700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:56.768408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e643e7-7e93-4510-b131-7c3187a4b946 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:56.797046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:56.797709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:56.798151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:56.798589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:56.799378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:56.801905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537099a-0f78-4648-a59e-d6d62916914d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.027141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 856/1728] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:56 2022] POST /identity/v3/projects => generated 357 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:57.027952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.045273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052169f-5c3f-4793-a00c-566ffee7adf0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.157520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774e6-2d01-4b48-9eff-74f63cd32b1b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.157845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774e6-2d01-4b48-9eff-74f63cd32b1b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.158160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225774e6-2d01-4b48-9eff-74f63cd32b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.250224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.252777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.255436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.258806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.259956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-225774e6-2d01-4b48-9eff-74f63cd32b1b None None] MFA Rules not processed for user `4a5b8b681436473d9b19f90910a8211c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:57.262952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-225774e6-2d01-4b48-9eff-74f63cd32b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.273235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.274336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a7198-5fd6-4dc7-ae4a-de44e74667be admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.338234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:57.352129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 857/1729] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:03:57.354106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.354962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.355705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.358226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 858/1730] 10.222.0.96 () {54 vars in 912 bytes} [Thu Sep 8 14:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:03:57.359765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.364840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.427080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 873/1731] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:57 2022] POST /identity/v3/users => generated 279 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:57.437144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319914a2-52be-426f-bed9-76c3bd0cfae6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.437404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319914a2-52be-426f-bed9-76c3bd0cfae6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.437686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319914a2-52be-426f-bed9-76c3bd0cfae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.498942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-319914a2-52be-426f-bed9-76c3bd0cfae6 None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:57.500783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-319914a2-52be-426f-bed9-76c3bd0cfae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.546942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5692db4-bcbf-41f6-9d99-ced9f3505420 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.558804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.559724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.560151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.560591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.566766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.582455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.585054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.598281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 859/1732] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:57.599596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.616401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b66bb-7596-4b4d-bc5c-574b740a8d97 service placement] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.623383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.624639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.625295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.625706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.626785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 874/1733] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:03:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:57.629117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.629405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.629838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.633542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.636478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.655990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 860/1734] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:57.658188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.668293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] MFA Rules not processed for user `4d3f02b889cb44969b170a61388ce05c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:57.669284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.670944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:57.704419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f04d58-2f12-40e5-9cac-872a70827589 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.717575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.718776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.719135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.719439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.743150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.745093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.769118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 861/1735] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:57.772603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.807468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8add-6a5e-4eeb-87a2-0de1c70881ae service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.824795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.825772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.826348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.826808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.828235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.840373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f6bd4-b3d9-44e3-b65e-7a0198161548 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:57.841147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 875/1736] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:57.886612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:57.886711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 862/1737] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:57.895471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:57.917733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b99b91-4da4-43a7-ac4b-afcc5ac7b6a9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:57.926137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:57.927200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:57.927552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:57.927835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] PATH_INFO: `/v3/projects/f7372f3c521d4d90816a00ad8e928750/users/2a1784b1ecbb4768bb3b2ec7004da5ef/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:57.954307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7372f3c521d4d90816a00ad8e928750, user_id=2a1784b1ecbb4768bb3b2ec7004da5ef, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:57.962950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:58.132303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 876/1738] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:57 2022] PUT /identity/v3/projects/f7372f3c521d4d90816a00ad8e928750/users/2a1784b1ecbb4768bb3b2ec7004da5ef/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:58.140820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:58.141105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:58.141677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:58.161128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:58.163104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:58.230209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] MFA Rules not processed for user `2a1784b1ecbb4768bb3b2ec7004da5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:58.237636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:58.350625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07bf81-09ca-438d-87f6-4c8cac715341 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:58.368419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:58.370674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:58.372632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:58.373167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] PATH_INFO: `/v3/users/b8b98856b3974250ba14b95329986415` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:58.378365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b98856b3974250ba14b95329986415)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:58.380875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:58.474735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 863/1739] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:58.480672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:58.518836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e7c7-35bd-4ab4-8576-54beb9702606 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:58.532135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:58.532963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:58.533247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:58.533517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:58.534173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:58.536139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:58.692373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b98856b3974250ba14b95329986415'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:58.693076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 864/1740] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:03:58 2022] POST /identity/v3/projects => generated 357 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:03:58.697332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:58.813539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b98856b3974250ba14b95329986415'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:58.854057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b98856b3974250ba14b95329986415'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:58.857105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b98856b3974250ba14b95329986415'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:59.122938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f8459-8d51-4e3b-ae0e-866fe167843b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.122938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.122938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.122938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.125330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.125330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.125500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:59.125605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4103f6a-e07e-4bd6-9bce-21e7943b7697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b98856b3974250ba14b95329986415'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 877/1741] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:03:58 2022] DELETE /identity/v3/users/b8b98856b3974250ba14b95329986415 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.125693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:03:59.126138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:59.149009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 865/1742] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:03:58 2022] POST /identity/v3/users => generated 285 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:03:59.151503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.162048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:59.189374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69056a40-2a24-4e55-b555-f0b3351c66a9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.197305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 878/1743] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:03:59.197566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.198406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.199638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.199934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.200858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.203374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.227407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 866/1744] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:59.229510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.233505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.239209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:59.262946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d3754-262e-46a7-9866-04c3a9622946 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.324839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.328036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.328036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.328036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] PATH_INFO: `/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85/users/849717be54704e44adf00e383d7843a2/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.398498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac892ab3d494e139fb6667fcf5c9e85, user_id=849717be54704e44adf00e383d7843a2, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.401660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.431439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29a278-d5d6-4e55-994e-47f9bf7b98f8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.435911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.440241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.440241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.440241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.451545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.455630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.483762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 867/1745] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:03:59.564144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 879/1746] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:59 2022] PUT /identity/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85/users/849717be54704e44adf00e383d7843a2/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:59.569136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.584958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4be2-b36d-4941-8bba-01a7a699d800 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.839339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.840182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.840592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.840971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.841772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.845609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984720cc-b90c-45ca-8b35-f2f3647a930d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.899057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 868/1747] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:03:59.903525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:59.925496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a0cb2-9b60-496a-9e80-6f442645994f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:59.938173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:59.939052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.939338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.939615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] PATH_INFO: `/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85/users/849717be54704e44adf00e383d7843a2/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:59.943160 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac892ab3d494e139fb6667fcf5c9e85, user_id=849717be54704e44adf00e383d7843a2, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:59.945885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:59.979915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 880/1748] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:03:59 2022] PUT /identity/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85/users/849717be54704e44adf00e383d7843a2/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:03:59.994054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:59.994746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:59.995212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:00.096188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] MFA Rules not processed for user `849717be54704e44adf00e383d7843a2`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:00.112662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:00.235465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:00.324779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 869/1749] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:03:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:00.347043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:00.352135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:00.567370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89e824-a5e7-4ff3-bab3-f747ffcde144 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:00.578827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:00.579711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:00.580163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:00.581289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:00.598794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:00.600923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:00.622456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 881/1750] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:00.829219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:00.840176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:01.097498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:01.099292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:01.118589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29d865-4eb2-491d-aba6-ff2994ff484e service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:01.134573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:01.136546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:01.140147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:01.140147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:01.143267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:01.147571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d6b5a-e9ed-403e-8f6a-7905c3eaa9f9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:01.160475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:01.161323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:01.161961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:01.162382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] PATH_INFO: `/v3/projects/697dd78c87e142f388792a42a4b99abc` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:01.164972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697dd78c87e142f388792a42a4b99abc)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:01.167210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:01.189297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:01.406667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:01.408666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652f3ab-6d48-47b9-ad0e-33dcb2727389 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:01.435412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 882/1751] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:01.466727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697dd78c87e142f388792a42a4b99abc', 'request_id': 'req-9371ba79-109e-4367-b090-7a95ccf7e822'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:01.484763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697dd78c87e142f388792a42a4b99abc', 'request_id': 'req-9371ba79-109e-4367-b090-7a95ccf7e822'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:01.503274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:01.505700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:01.506336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:01.507897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697dd78c87e142f388792a42a4b99abc', 'request_id': 'req-9371ba79-109e-4367-b090-7a95ccf7e822'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:01.546666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] MFA Rules not processed for user `43f50b6d10f94b8aa55dd3f2f6ea971e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:01.548058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:01.680111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 883/1752] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:01.704462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] The token cache is being invalidate because project 697dd78c87e142f388792a42a4b99abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:01.704818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:01.705856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:01.720883 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 870/1753] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:00 2022] DELETE /identity/v3/projects/697dd78c87e142f388792a42a4b99abc => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:01.730208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:02.065584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7220191-3f07-4cff-86a5-65c59707e99f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:02.078699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:02.079357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:02.079638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:02.081055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] PATH_INFO: `/v3/users/4f54267d8a5b46d78b0cc7e1caf995fa` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:02.086556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f54267d8a5b46d78b0cc7e1caf995fa)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:02.090122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:02.365938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:02.456821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f54267d8a5b46d78b0cc7e1caf995fa'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:02.557564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f54267d8a5b46d78b0cc7e1caf995fa'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:02.612357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f54267d8a5b46d78b0cc7e1caf995fa'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:02.613041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f54267d8a5b46d78b0cc7e1caf995fa'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:02.640457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d174ebae-82ef-4992-a491-84f4a507c695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f54267d8a5b46d78b0cc7e1caf995fa'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:02.656459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 884/1754] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:01 2022] DELETE /identity/v3/users/4f54267d8a5b46d78b0cc7e1caf995fa => generated 0 bytes in 928 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:03.337549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:03.339009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:03.370858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371ba79-109e-4367-b090-7a95ccf7e822 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:03.539552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:03.540810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:03.541240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:03.541726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] PATH_INFO: `/v3/projects/bf4868b52c2d4697a673e500c22d5e0b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:03.543392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4868b52c2d4697a673e500c22d5e0b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:03.545693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:03.825123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4868b52c2d4697a673e500c22d5e0b', 'request_id': 'req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:03.839140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4868b52c2d4697a673e500c22d5e0b', 'request_id': 'req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:03.862475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4868b52c2d4697a673e500c22d5e0b', 'request_id': 'req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:04.015724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] The token cache is being invalidate because project bf4868b52c2d4697a673e500c22d5e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:04.016381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:04.019769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cba9e1a8-36a3-4e36-b3ba-a84f09ecb948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:04.022594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 871/1755] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:03 2022] DELETE /identity/v3/projects/bf4868b52c2d4697a673e500c22d5e0b => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:04.027672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:04.028182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:04.028383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:04.097580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:04.101324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:04.344178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 885/1756] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:04.353022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:04.353633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:04.354238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:04.416946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:04.418292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:04.438271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 872/1757] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:04.442193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:04.496898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd2d10-737d-492f-a731-31aadcce58af None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:04.512996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:04.514062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:04.525252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:04.525655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:04.526422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:04.527296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:04.529977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895b1a-85e0-4eff-921f-627a60862a97 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:04.550170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:04.566563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 886/1758] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:04.569571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:04.570238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:04.574372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27dfcbe-ef55-42dc-b2d4-5dbbe44136ca None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:04.575744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:04.586093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:04.586816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:04.587107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:04.587381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:04.588030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:04.591366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:04.692099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:04.693265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:04.781144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 887/1759] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:04.786635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:04.802434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:04.894796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 873/1760] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:04 2022] POST /identity/v3/projects => generated 385 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:04.899738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:04.913541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c41b52-67c6-45ce-8c0d-2f6bc97c914c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.028961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.029611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.029896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.030177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.033350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:05.106577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d68df-8a94-4267-8b69-8ae5d6bcd83d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.129773 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.130432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.130713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.130995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.131672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:05.133867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:05.295461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 874/1761] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:04 2022] POST /identity/v3/users => generated 293 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:05.299869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:05.300786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:05.322496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e433f-f7c9-4701-877b-08319dc5d1d1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.328618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.329819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.330287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.330765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.331556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:05.333583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:05.347665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 875/1762] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:05.355641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:05.370949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941ce2e-ce95-4188-8c31-db731f5626a4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.379787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.382802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.386254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.386254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.386254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:05.386596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:05.386707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:05.396585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:05.407793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 876/1763] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:05.410713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:05.432000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805ca67-e965-47b4-ad9d-f58c3af5f7dd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.450777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 888/1764] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:05.464746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:05.479892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:05.486057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.486878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.487321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.487750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] PATH_INFO: `/v3/projects/07c50c94c9774aab97c3f859db653225/users/fb2142a91e5c4f19a0d2881be57a873a/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.521562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c50c94c9774aab97c3f859db653225, user_id=fb2142a91e5c4f19a0d2881be57a873a, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:05.529288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64096f45-3abb-4ecb-bf35-4ca15cdcd830 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:05.543663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:05.720595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 877/1765] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:05 2022] PUT /identity/v3/projects/07c50c94c9774aab97c3f859db653225/users/fb2142a91e5c4f19a0d2881be57a873a/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:05.733987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.734537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.735181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.740398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e911-41a1-4cc2-9eff-b5e5b390a7c8 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:05.809862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] MFA Rules not processed for user `fb2142a91e5c4f19a0d2881be57a873a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:05.813980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:05.957801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:05.958711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:05.959146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:05.959570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:05.985781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 878/1766] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:05.987411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:06.097562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:06.113926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:06.133079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 889/1767] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:04:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:04:06.143590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb101c-0ad5-4ef0-bde7-596c0c9183f0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:06.149794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:06.150578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:06.150959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:06.151801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:06.152663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:06.155312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:06.327216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:06.329333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 879/1768] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:05 2022] POST /identity/v3/projects => generated 387 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:06.378941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64dedb-b421-4938-939a-d48935e1f61b service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:06.450666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:06.778482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:06.778482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:06.778482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:06.778482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:06.778806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:06.779854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:06.913858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 890/1769] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:06 2022] POST /identity/v3/users => generated 300 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:06.918889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:06.940300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86927d3-51d2-44fe-b409-e888ff2d13ab admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:06.954606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:06.955479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:06.955925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:06.956225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:06.956894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:06.960877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:06.997246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 880/1770] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:07.003569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:07.019861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd33c18-38be-4ed3-9061-e5b8e9937aaa admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:07.035591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:07.040241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:07.040791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:07.041318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] PATH_INFO: `/v3/projects/e11bfc023f9745969140f7c3b405a3ae/users/0be7080124ac4348b1382a86a3cd35ae/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:07.082553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11bfc023f9745969140f7c3b405a3ae, user_id=0be7080124ac4348b1382a86a3cd35ae, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:07.090521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:07.188787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:07.190318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 891/1771] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:07 2022] PUT /identity/v3/projects/e11bfc023f9745969140f7c3b405a3ae/users/0be7080124ac4348b1382a86a3cd35ae/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:07.214466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a700d9-9e19-41f6-adb3-4843863c723f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:07.579237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:07.582376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:07.596996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:07.597914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:07.599499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:07.628697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782616e-5e6f-423f-81a6-8462275354ef admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:07.710676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 881/1772] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:07.712971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:07.773388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ffeb-160b-4e85-b31c-1f1e52feb0c7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:07.820415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:07.850074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:07.850074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:07.850074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] PATH_INFO: `/v3/projects/e11bfc023f9745969140f7c3b405a3ae/users/0be7080124ac4348b1382a86a3cd35ae/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:07.855967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11bfc023f9745969140f7c3b405a3ae, user_id=0be7080124ac4348b1382a86a3cd35ae, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:07.869272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f698fe-dd08-4660-8c7a-3c79aa3a885f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:07.920547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 892/1773] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:07 2022] PUT /identity/v3/projects/e11bfc023f9745969140f7c3b405a3ae/users/0be7080124ac4348b1382a86a3cd35ae/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:07.939090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:07.940034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:07.940510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:07.951498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:07.952066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:07.953139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:08.050759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:08.052091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:08.055314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] MFA Rules not processed for user `0be7080124ac4348b1382a86a3cd35ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:08.058475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:08.246522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 893/1774] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:08.257888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:08.259732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:08.346967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 882/1775] 10.222.0.102 () {58 vars in 1016 bytes} [Thu Sep 8 14:04:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:08.385813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31951c91-3b9c-4865-b9bc-3cfe8cdb39af None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:08.390561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:08.391324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:08.391608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:08.391891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:08.398694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:08.400577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:08.415500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:08.417463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:08.425301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7672c80-c314-48f2-a23e-dc619dd08f8f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:08.456934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:08.459295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:08.460564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:08.461034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:08.469484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 894/1776] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:08.513023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:08.514985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008f460-c007-4bde-8378-ee44d6c015d6 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:08.539393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 883/1777] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:08.794130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:08.796041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:08.826918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421a0f6-9dd6-4708-91c3-decbdaf032cb service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:08.837212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:08.840705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:08.840705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:08.840705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:08.937156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:08.945183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a7212-eacd-44ad-ab86-3f94f09899ff service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:08.997508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 895/1778] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:09.556696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:10.452783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:11.401286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11b68-2aab-432c-9ecd-dc3b318e8f16 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:11.401828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11b68-2aab-432c-9ecd-dc3b318e8f16 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:11.401828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff11b68-2aab-432c-9ecd-dc3b318e8f16 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:11.405055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 884/1779] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:04:11.515573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:11.516161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:11.516161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:11.605009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:11.609759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:11.700237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:11.721185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11b68-2aab-432c-9ecd-dc3b318e8f16 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:11.846848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 896/1780] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:04:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:11.855675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff11b68-2aab-432c-9ecd-dc3b318e8f16 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:11.866694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:11.867710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:11.868028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:11.868482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] PATH_INFO: `/v3/users/fb2142a91e5c4f19a0d2881be57a873a` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:11.870965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2142a91e5c4f19a0d2881be57a873a)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:11.875300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:11.948617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:11.952953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:11.994174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cc940-485c-4612-aa3f-b31ff078536c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:12.038963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:12.039784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:12.040254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:12.040602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:12.073342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:12.075517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f625d1-c9a1-454e-a28e-8304550c4faa service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:12.108114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 897/1781] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:12.135344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2142a91e5c4f19a0d2881be57a873a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:12.173827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2142a91e5c4f19a0d2881be57a873a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:12.175576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2142a91e5c4f19a0d2881be57a873a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:12.188684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2142a91e5c4f19a0d2881be57a873a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:12.286361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2142a91e5c4f19a0d2881be57a873a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:12.303991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 885/1782] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:11 2022] DELETE /identity/v3/users/fb2142a91e5c4f19a0d2881be57a873a => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:12.308695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:12.309093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:12.309676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:12.388405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:12.400496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:12.601724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 898/1783] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:12.699645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:12.705099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:12.726196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:12.863909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed161f3-e565-4370-9d5d-2712ee8d0f8d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:12.878565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:12.879151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:12.879738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:12.880170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:12.895901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:12.898711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ed8a2-2b49-4c3d-972c-8786de4a48a2 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:12.937668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 886/1784] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:13.412260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:13.418404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:13.465278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e48fc-8cb1-449d-a49e-89b8e98053f0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:13.467441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:13.475916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:13.476618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:13.476901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:13.477365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] PATH_INFO: `/v3/users/b83b67fafa17489685fc76a65cd4b603` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:13.485246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83b67fafa17489685fc76a65cd4b603)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:13.487715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:13.813159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83b67fafa17489685fc76a65cd4b603'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:13.891852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83b67fafa17489685fc76a65cd4b603'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:13.913568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83b67fafa17489685fc76a65cd4b603'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:13.914504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83b67fafa17489685fc76a65cd4b603'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:13.940820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83b67fafa17489685fc76a65cd4b603'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:13.959806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 899/1785] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:13 2022] DELETE /identity/v3/users/b83b67fafa17489685fc76a65cd4b603 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:13.961390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f6fa-6242-43f5-912d-f5c3f2c17d2c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:13.961876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f6fa-6242-43f5-912d-f5c3f2c17d2c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:13.962001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83f6fa-6242-43f5-912d-f5c3f2c17d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:14.033696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ef83f6fa-6242-43f5-912d-f5c3f2c17d2c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:14.034916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ef83f6fa-6242-43f5-912d-f5c3f2c17d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:14.150942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 887/1786] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:14.232486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:14.234952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:14.545968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1b29-1de0-45d2-8e27-7042071cb730 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:14.563063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:14.564051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:14.564566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:14.565172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:14.603329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:14.604880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7b432-e22c-4df1-b07f-f17d30a1bca5 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:14.638456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 900/1787] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:14.831441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:14.832315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:14.832315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:14.833848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 888/1788] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:04:14.867919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:14.868549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:14.868814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:14.953165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:14.954476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:14.984425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:14.987406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:15.017375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba7154-2c14-4ba7-b850-4e95d3d203ea None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:15.024513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:15.025396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:15.025853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:15.026282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] PATH_INFO: `/v3/projects/07c50c94c9774aab97c3f859db653225` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:15.027852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c50c94c9774aab97c3f859db653225)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:15.031149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:15.090198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:15.183891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 901/1789] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:04:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:15.191264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c50c94c9774aab97c3f859db653225', 'request_id': 'req-6a85a6fc-ccae-4673-8a7c-aaa62a743098'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.207689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c50c94c9774aab97c3f859db653225', 'request_id': 'req-6a85a6fc-ccae-4673-8a7c-aaa62a743098'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.220118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c50c94c9774aab97c3f859db653225', 'request_id': 'req-6a85a6fc-ccae-4673-8a7c-aaa62a743098'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.303619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] The token cache is being invalidate because project 07c50c94c9774aab97c3f859db653225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:15.303914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.305102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.307381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 889/1790] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:14 2022] DELETE /identity/v3/projects/07c50c94c9774aab97c3f859db653225 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:15.312144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:15.328490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475f1b-8d2a-4523-8df2-a6bc33f956cb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:15.503398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:15.504253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:15.504600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:15.504940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] PATH_INFO: `/v3/users/0be7080124ac4348b1382a86a3cd35ae` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:15.507529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be7080124ac4348b1382a86a3cd35ae)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:15.516162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:15.794093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:15.810148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be7080124ac4348b1382a86a3cd35ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.899740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be7080124ac4348b1382a86a3cd35ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.918210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be7080124ac4348b1382a86a3cd35ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.937573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be7080124ac4348b1382a86a3cd35ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.947443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be7080124ac4348b1382a86a3cd35ae'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:15.971911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 902/1791] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:15 2022] DELETE /identity/v3/users/0be7080124ac4348b1382a86a3cd35ae => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:16.013811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:16.017142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:16.221998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a85a6fc-ccae-4673-8a7c-aaa62a743098 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:16.393127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:16.394110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:16.394578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:16.397120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:16.406050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:16.430049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:16.430897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:16.447006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 890/1792] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:16.946956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:16.955357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:17.193494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922acfc-6836-4eba-83b3-3610a80f7c61 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:17.229623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:17.237893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:17.238276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:17.238754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] PATH_INFO: `/v3/projects/ef690849f0fe4914a8edd39c09d9479d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:17.242796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef690849f0fe4914a8edd39c09d9479d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:17.246148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:17.437613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef690849f0fe4914a8edd39c09d9479d', 'request_id': 'req-12fe91b6-9c43-46af-a569-af84fe399a10'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:17.529296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef690849f0fe4914a8edd39c09d9479d', 'request_id': 'req-12fe91b6-9c43-46af-a569-af84fe399a10'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:17.536918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef690849f0fe4914a8edd39c09d9479d', 'request_id': 'req-12fe91b6-9c43-46af-a569-af84fe399a10'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:17.568048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] The token cache is being invalidate because project ef690849f0fe4914a8edd39c09d9479d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:17.568048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:17.568048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:17.576533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 903/1793] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:16 2022] DELETE /identity/v3/projects/ef690849f0fe4914a8edd39c09d9479d => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:17.578726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:17.616620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518e22e-5e41-4ca8-b06a-52f1352dfeb6 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:17.740338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:17.741611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:17.743059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:17.743059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] PATH_INFO: `/v3/users/e915d48b231b4695945186c33b2ca4fc` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:17.744849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e915d48b231b4695945186c33b2ca4fc)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:17.750140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:17.950995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:17.952581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:17.967733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe91b6-9c43-46af-a569-af84fe399a10 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:17.976617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:17.982358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:17.988927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:17.988927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] PATH_INFO: `/v3/projects/e11bfc023f9745969140f7c3b405a3ae` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:17.988927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11bfc023f9745969140f7c3b405a3ae)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:17.988927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:18.069404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e915d48b231b4695945186c33b2ca4fc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.104652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e915d48b231b4695945186c33b2ca4fc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.104652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e915d48b231b4695945186c33b2ca4fc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.115195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e915d48b231b4695945186c33b2ca4fc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.195266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11bfc023f9745969140f7c3b405a3ae', 'request_id': 'req-5d977260-9c41-4b77-906d-686bf9b8dc4c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.238254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-58153067-157a-4483-af5a-29d47d67dc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e915d48b231b4695945186c33b2ca4fc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.247727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 891/1794] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:17 2022] DELETE /identity/v3/users/e915d48b231b4695945186c33b2ca4fc => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:18.348634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11bfc023f9745969140f7c3b405a3ae', 'request_id': 'req-5d977260-9c41-4b77-906d-686bf9b8dc4c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.364538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11bfc023f9745969140f7c3b405a3ae', 'request_id': 'req-5d977260-9c41-4b77-906d-686bf9b8dc4c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.372458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] The token cache is being invalidate because project e11bfc023f9745969140f7c3b405a3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:18.372853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.374888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5d977260-9c41-4b77-906d-686bf9b8dc4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:18.377097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 904/1795] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:17 2022] DELETE /identity/v3/projects/e11bfc023f9745969140f7c3b405a3ae => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:18.382871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:18.389298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:18.389298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:18.410651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:18.412047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:18.499381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 892/1796] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:18.508642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:18.508948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:18.509526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:18.531995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:18.533276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:18.542599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 905/1797] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:18.547116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:18.558129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc3bd2-b693-4cae-a009-db463a6c6fad None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:18.595627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:18.596417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:18.604969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:18.604969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:18.604969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:18.604969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:18.604969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:18.669273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:18.673087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:18.680325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 893/1798] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:18.686222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63674b5-0517-4c1d-be68-5aa27d753542 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:18.705718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:18.706591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:18.707013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:18.707525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:18.710045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:18.713674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:18.814867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 906/1799] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:18.815512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:18.834282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b8d4a-3d49-46aa-b69d-e1302cb6ddcc admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:18.967234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:18.967939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:18.968284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:18.968569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:18.969237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:18.971827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.132050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 894/1800] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:18 2022] POST /identity/v3/users => generated 290 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:19.138092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:19.157090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1ce1-da2d-4d14-b91a-d50eb414d447 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:19.162842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:19.163803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.164402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.164887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.165853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:19.168289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.182900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 907/1801] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:19.187742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:19.199906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956e297-1ca4-4a13-a9a7-69d964289caf admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:19.207800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:19.208805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.209248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.209710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.210729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:19.213411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102443e-0e68-4f7a-9f9c-215ef8e3ffe2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.242384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 895/1802] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:19.248471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:19.253695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:19.267731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710c3f-b9e1-4be1-9f8f-85dcdd85c51d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:19.277662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:19.278648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.279044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.279482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] PATH_INFO: `/v3/projects/4fe6426d427d41e68d3170a40cfbd472/users/d1457c8fb5434242844db7b352eaaa74/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.301559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fe6426d427d41e68d3170a40cfbd472, user_id=d1457c8fb5434242844db7b352eaaa74, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:19.307337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.389855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 908/1803] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:19 2022] PUT /identity/v3/projects/4fe6426d427d41e68d3170a40cfbd472/users/d1457c8fb5434242844db7b352eaaa74/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:19.400983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.401265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.401602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.440181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:19.441933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:19.502556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] MFA Rules not processed for user `d1457c8fb5434242844db7b352eaaa74`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:19.505025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:19.618289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d381-729f-4934-86bc-e2d525ddd41c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:19.633353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:19.634060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.634500 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.634604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] PATH_INFO: `/v3/projects/62fef83617e944a0bc6c051e0a83e55e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.638618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fef83617e944a0bc6c051e0a83e55e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:19.659750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.666787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 896/1804] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:19.672467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:19.705187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4514a-729a-45b6-9bb2-c55ab6528946 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:19.733762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:19.734487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:19.734970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:19.735752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:19.737211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:19.739457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:19.873152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fef83617e944a0bc6c051e0a83e55e', 'request_id': 'req-6167f728-11b4-4885-a109-61083c7c0df9'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:19.935208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 897/1805] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:19 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:19.936428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:20.038269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fef83617e944a0bc6c051e0a83e55e', 'request_id': 'req-6167f728-11b4-4885-a109-61083c7c0df9'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:20.054147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea12c00d-3f3d-4503-9c24-28df27cb05e5 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:20.054907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fef83617e944a0bc6c051e0a83e55e', 'request_id': 'req-6167f728-11b4-4885-a109-61083c7c0df9'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:20.091142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:20.091932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:20.092442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:20.092801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:20.094302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:20.097388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:20.122120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] The token cache is being invalidate because project 62fef83617e944a0bc6c051e0a83e55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:20.124238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:20.125264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:20.141841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 909/1806] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:19 2022] DELETE /identity/v3/projects/62fef83617e944a0bc6c051e0a83e55e => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:20.143538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:20.145870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:20.188917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 898/1807] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:19 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:20.192869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:20.198354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:20.235574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caefdea1-97d4-46a8-81fe-13d9c7007e30 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:20.247268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:20.248336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:20.248869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:20.249433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:20.250672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:20.252488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:20.289407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 899/1808] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:20.299706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:20.324569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167f728-11b4-4885-a109-61083c7c0df9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:20.340936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:20.344459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:20.345449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:20.346277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4220af-aaac-4454-98ca-e2757463a414 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:20.346681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] PATH_INFO: `/v3/users/d19c8d49a9504be8b2526b150a204286` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:20.351415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19c8d49a9504be8b2526b150a204286)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:20.364650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:20.367588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:20.368296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:20.368586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:20.370955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] PATH_INFO: `/v3/projects/e4ff7b2b000446589eb03febcb586250/users/b0854c64aa94436081e462e4e8d1aaa7/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:20.443817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ff7b2b000446589eb03febcb586250, user_id=b0854c64aa94436081e462e4e8d1aaa7, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:20.453924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:20.971187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 900/1809] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:20 2022] PUT /identity/v3/projects/e4ff7b2b000446589eb03febcb586250/users/b0854c64aa94436081e462e4e8d1aaa7/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:20.976030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:21.042325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da7e56-9dae-428b-a401-b9814fc4fd39 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:21.056334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:21.056334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.056334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.056334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.056649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:21.056649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:21.069176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 901/1810] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:21.073361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:21.085946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcafd62-2c56-4d49-ba47-796a944be2a5 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:21.096230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:21.096230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.096230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.096230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] PATH_INFO: `/v3/projects/e4ff7b2b000446589eb03febcb586250/users/b0854c64aa94436081e462e4e8d1aaa7/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.096620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ff7b2b000446589eb03febcb586250, user_id=b0854c64aa94436081e462e4e8d1aaa7, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:21.098128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0201cb-f945-4ecd-9620-783a5b8e0440 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:21.112264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 902/1811] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:21 2022] PUT /identity/v3/projects/e4ff7b2b000446589eb03febcb586250/users/b0854c64aa94436081e462e4e8d1aaa7/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:21.121926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.122211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.122573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.157317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] MFA Rules not processed for user `b0854c64aa94436081e462e4e8d1aaa7`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:21.158664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:21.183429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19c8d49a9504be8b2526b150a204286'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:21.241629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 903/1812] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:21.253474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:21.254827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:21.274291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19c8d49a9504be8b2526b150a204286'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:21.288462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19c8d49a9504be8b2526b150a204286'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:21.289183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19c8d49a9504be8b2526b150a204286'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:21.296562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19c8d49a9504be8b2526b150a204286'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:21.303247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 910/1813] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:20 2022] DELETE /identity/v3/users/d19c8d49a9504be8b2526b150a204286 => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:21.317291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94642d-f2e6-4304-8a88-120e90160c8e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:21.366673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:21.367287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.367561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.367831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.369936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:21.436083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:21.438036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:21.448014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 904/1814] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:21.488737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:21.821609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:21.823494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:21.900922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547b2d9-3db9-4465-8812-ceb723cb1628 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:21.906244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:21.910697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.910697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.910697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] PATH_INFO: `/v3/projects/b622ae3f6d544170b1ff2731f7119f36` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.910697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b622ae3f6d544170b1ff2731f7119f36)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:21.910697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.018960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:22.052624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b622ae3f6d544170b1ff2731f7119f36', 'request_id': 'req-495e7f70-777d-4aff-91e4-d972a7fbe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.112072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.114244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.137653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c8a39-0d1f-4226-92cf-069342b8d692 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.145369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b622ae3f6d544170b1ff2731f7119f36', 'request_id': 'req-495e7f70-777d-4aff-91e4-d972a7fbe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.153640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b622ae3f6d544170b1ff2731f7119f36', 'request_id': 'req-495e7f70-777d-4aff-91e4-d972a7fbe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.182593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] The token cache is being invalidate because project b622ae3f6d544170b1ff2731f7119f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:22.183991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.184718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-495e7f70-777d-4aff-91e4-d972a7fbe65a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.190700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 911/1815] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:21 2022] DELETE /identity/v3/projects/b622ae3f6d544170b1ff2731f7119f36 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:22.192986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ba37-6c43-4b2c-889b-d8759f42d35f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.193536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ba37-6c43-4b2c-889b-d8759f42d35f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.193820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279ba37-6c43-4b2c-889b-d8759f42d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.209130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.209777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.210059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.210337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] PATH_INFO: `/v3/users/d1457c8fb5434242844db7b352eaaa74` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.211615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1457c8fb5434242844db7b352eaaa74)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.213727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.215524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e279ba37-6c43-4b2c-889b-d8759f42d35f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:22.216844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e279ba37-6c43-4b2c-889b-d8759f42d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.226153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 912/1816] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:22.235396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.235796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.236226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.260686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:22.261908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.270222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 913/1817] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:22.274446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.283525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b693330-de00-42d5-9a3b-cbbc194e4a4e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.288239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.288839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.289125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.289405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.290058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:22.290364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.291951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.309031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 914/1818] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:04:22.310212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.322817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126beaf-7e87-4d96-b9aa-4509e183fba7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.329292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.329910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.330197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.330474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.331114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.333053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.400054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1457c8fb5434242844db7b352eaaa74'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.412827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1457c8fb5434242844db7b352eaaa74'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.413570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1457c8fb5434242844db7b352eaaa74'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.422495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1457c8fb5434242844db7b352eaaa74'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.423740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 915/1819] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/projects => generated 401 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:22.427795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.429582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.494498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304986f-b6eb-4e0f-bb6d-bc1074e20b43 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.499423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.500576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.500860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.501139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.501769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.503718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.528455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d85786e9-59ad-4bc5-99ba-28a99a7f9b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1457c8fb5434242844db7b352eaaa74'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:22.534853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 905/1820] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:22 2022] DELETE /identity/v3/users/d1457c8fb5434242844db7b352eaaa74 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:22.539382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.539382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.539587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.559881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:22.562478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.603004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 916/1821] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/users => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:22.607373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.619779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee093463-9a8d-4383-9249-c208f889f56f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.624906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.625518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.625816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.626077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.626172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 906/1822] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:22.626731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.628413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.635898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.637399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.639379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 917/1823] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:22.643463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.653541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353594e6-0e76-4b79-a609-50cd6d30f4ae admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.664189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.664853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.665141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.665419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.666074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.667661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.679366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 918/1824] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:22.683594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.693750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56bc6d-3e13-4d34-9fa7-1f1d931da627 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.695645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ceae4-4a59-4cdc-9b82-bf838527d741 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.698550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.699209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.699345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.699520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.699762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] PATH_INFO: `/v3/projects/51b42277f3654491a18e3a3ee47c7aed/users/7c84b546e48b4e38a2e3e237d8cdbcce/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.699876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.700084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.700422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.710178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.711615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54818e-9ebe-4abd-bede-49121bef477e service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.714825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b42277f3654491a18e3a3ee47c7aed, user_id=7c84b546e48b4e38a2e3e237d8cdbcce, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.717532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.721831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 907/1825] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:22.789983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 919/1826] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:22 2022] PUT /identity/v3/projects/51b42277f3654491a18e3a3ee47c7aed/users/7c84b546e48b4e38a2e3e237d8cdbcce/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:22.816616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.816616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.820295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.851834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] MFA Rules not processed for user `7c84b546e48b4e38a2e3e237d8cdbcce`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:22.853127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.914203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:22.940566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 908/1827] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:22.945139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.021971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e885f-b4d1-4653-908e-16f916b39709 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.027241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.028457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.028457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.028457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.029221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.031128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.138756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 920/1828] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/projects => generated 399 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:23.139997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.165567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af59d67-e48e-4dd2-b01e-c89d189cc260 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.277106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.277786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.278276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.278753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.279545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.281756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.399904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.406113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:23.410746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 909/1829] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:23 2022] POST /identity/v3/users => generated 306 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:23.411939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.426385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a0f5f-c634-4bc2-b89c-fd958c5475ee admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.426534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adfcf3-f96b-46ea-a077-3a06fef967f7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.447277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.448901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.449206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.449488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] PATH_INFO: `/v3/projects/4fe6426d427d41e68d3170a40cfbd472` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.450682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.451745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fe6426d427d41e68d3170a40cfbd472)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.452047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.452607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.453075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.453939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.454623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.456440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.479093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 910/1830] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:23.484406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.498693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22e281-a313-4170-9f54-93f684cb0a0f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.504268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.504944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.505225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.505496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] PATH_INFO: `/v3/projects/effb399bb0e74be49aa0c87b23d0c163/users/15d297b579014909a9eaccfb652963e5/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.521970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=effb399bb0e74be49aa0c87b23d0c163, user_id=15d297b579014909a9eaccfb652963e5, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.525025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.642807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 911/1831] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:23 2022] PUT /identity/v3/projects/effb399bb0e74be49aa0c87b23d0c163/users/15d297b579014909a9eaccfb652963e5/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:23.648009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.658405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fe6426d427d41e68d3170a40cfbd472', 'request_id': 'req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:23.719284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139756c-08c8-429b-9677-b796b411b63b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.723976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.724650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.724935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.725210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.725858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.727450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.737900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 912/1832] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:23.742102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.752484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411468a-5611-4ba3-837d-3d8ee94f967e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.757107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.757810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.758100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.758377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] PATH_INFO: `/v3/projects/effb399bb0e74be49aa0c87b23d0c163/users/15d297b579014909a9eaccfb652963e5/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.760308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effb399bb0e74be49aa0c87b23d0c163, user_id=15d297b579014909a9eaccfb652963e5, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.762935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a79c07-33f3-4400-81c9-f2f2398b6103 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.783685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fe6426d427d41e68d3170a40cfbd472', 'request_id': 'req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:23.783847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 913/1833] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:23 2022] PUT /identity/v3/projects/effb399bb0e74be49aa0c87b23d0c163/users/15d297b579014909a9eaccfb652963e5/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:23.785213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fe6426d427d41e68d3170a40cfbd472', 'request_id': 'req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:23.786598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.786893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.787170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.798228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] The token cache is being invalidate because project 4fe6426d427d41e68d3170a40cfbd472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:23.798607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:23.799325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:23.801123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 921/1834] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:23 2022] DELETE /identity/v3/projects/4fe6426d427d41e68d3170a40cfbd472 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:23.804829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.806225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:23.818228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] MFA Rules not processed for user `15d297b579014909a9eaccfb652963e5`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:23.819719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:23.874603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804b8c0-83bb-4f2f-8b36-566e818e8fcb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.892178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 914/1835] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:23.903574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:23.905484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:23.935624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.936358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.936572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.936873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] PATH_INFO: `/v3/users/b0854c64aa94436081e462e4e8d1aaa7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.938943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0854c64aa94436081e462e4e8d1aaa7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.940904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.965708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18693a5-784f-4d8e-a2cb-eb827415ecdc None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:23.970484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:23.971134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:23.971413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:23.971685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:23.981726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:23.983161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.992862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 915/1836] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:24.189466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0854c64aa94436081e462e4e8d1aaa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:24.208722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:24.252813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:24.254897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0854c64aa94436081e462e4e8d1aaa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:24.261641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84030874-0cb5-4f5f-8642-1e4f95e646de service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:24.265986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:24.266594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:24.267014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:24.267301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:24.269104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:24.271431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0854c64aa94436081e462e4e8d1aaa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:24.272266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0854c64aa94436081e462e4e8d1aaa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:24.280813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0854c64aa94436081e462e4e8d1aaa7'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:24.287196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 922/1837] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:23 2022] DELETE /identity/v3/users/b0854c64aa94436081e462e4e8d1aaa7 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:24.337377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:24.339756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc0fbe-0aa2-4f86-b47d-553ba0601137 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:24.351777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 916/1838] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:24.879461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:24.880942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:24.949211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b37ce-3334-4f5d-8862-88a4dfccb841 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:24.954445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:24.955079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:24.955356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:24.955627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] PATH_INFO: `/v3/projects/e4ff7b2b000446589eb03febcb586250` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:24.956823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ff7b2b000446589eb03febcb586250)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:24.963477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:25.138176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ff7b2b000446589eb03febcb586250', 'request_id': 'req-94400b65-a8f9-4b6f-b2ee-9f58f3182445'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:25.200448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ff7b2b000446589eb03febcb586250', 'request_id': 'req-94400b65-a8f9-4b6f-b2ee-9f58f3182445'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:25.207855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ff7b2b000446589eb03febcb586250', 'request_id': 'req-94400b65-a8f9-4b6f-b2ee-9f58f3182445'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:25.220419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] The token cache is being invalidate because project e4ff7b2b000446589eb03febcb586250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:25.220748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:25.221378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-94400b65-a8f9-4b6f-b2ee-9f58f3182445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:25.222898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 923/1839] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:24 2022] DELETE /identity/v3/projects/e4ff7b2b000446589eb03febcb586250 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:25.229506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:25.230040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:25.230382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:25.252751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:25.254063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:25.315145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 917/1840] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:25.323296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:25.323610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:25.324220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:25.345070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:25.346378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:25.354465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 924/1841] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:25.359409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:25.369455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71278b28-9ac3-47b4-be68-105375ababc3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:25.375306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:25.375927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:25.376230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:25.376592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:25.378473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:25.378473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:25.379487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:25.392230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 918/1842] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:25.396844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:25.406629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e6ea2-9bf3-42d9-a665-c25610cacb11 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:25.411954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:25.412625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:25.412908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:25.413217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:25.413861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:25.415744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:25.423926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:25.518955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 925/1843] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:25 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:25.523240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:25.533532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424590da-ba03-43ba-87ed-3fa63911ed69 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:25.626787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:25.627995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:25.629541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:25.637274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:25.637274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:25.637274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:26.645924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 919/1844] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:25 2022] POST /identity/v3/users => generated 291 bytes in 1123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:26.650304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:26.661014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea9d6-9f90-4524-bd2d-696bc9ec9c7e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:26.665745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:26.666345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:26.666621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:26.667100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:26.667747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:26.669732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:26.680711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 926/1845] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:26.685420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:26.697339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a192ea-f58b-4dc4-a9f0-47babe5b1252 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:26.702301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:26.703550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:26.703829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:26.704104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:26.704819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:26.706456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0e21f-b7aa-49d1-aeef-dfab7fa25ef6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:26.717848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 920/1846] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:26.721891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:26.732272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0dcbc-095a-4b42-ac84-89482afb2f45 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:26.737456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:26.738115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:26.738405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:26.738694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] PATH_INFO: `/v3/projects/92d5d6da40af4e12b37c92c37c16da90/users/805303114f63467e876d9ccead36ff49/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:26.756685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d5d6da40af4e12b37c92c37c16da90, user_id=805303114f63467e876d9ccead36ff49, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:26.759555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:26.905398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 927/1847] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:26 2022] PUT /identity/v3/projects/92d5d6da40af4e12b37c92c37c16da90/users/805303114f63467e876d9ccead36ff49/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:26.916375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:26.916375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:26.916828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:26.987000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] MFA Rules not processed for user `805303114f63467e876d9ccead36ff49`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:26.987000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:27.098321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 921/1848] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:27.102666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.201643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a2151-e15b-4103-b70e-c356e31d46ab admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.208431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.208431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.208431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.208431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.208732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.210922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.304307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 928/1849] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:27.308288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.319581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2eb5c-4a20-4554-9c0f-5e7bf993062f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.377855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:27.378463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.379080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.379360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.379635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.380292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.382242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.507742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 922/1850] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:27 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:27.511241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.522316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c732c-050c-4fec-ad9a-1567d48b8670 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.527610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.528240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.528526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.528808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.529455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.536378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.543264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 929/1851] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:27.547363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.557756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcc164-5bb2-4274-ba4b-24b0d1981777 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.565008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.565008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.565008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.565008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] PATH_INFO: `/v3/projects/5090f4e545474173b4f2aa12abd1c493/users/ba9f7b5dbe7248dfa67eccb78d1cebc5/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.580349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090f4e545474173b4f2aa12abd1c493, user_id=ba9f7b5dbe7248dfa67eccb78d1cebc5, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.583028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.686157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 923/1852] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:27 2022] PUT /identity/v3/projects/5090f4e545474173b4f2aa12abd1c493/users/ba9f7b5dbe7248dfa67eccb78d1cebc5/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:27.690079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.700238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29996bf4-b11e-4e18-9722-ab82e9ae5895 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.759697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.760354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.760636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.760915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.761576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.763262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bec9e-10bf-4e20-a871-fc4c32b62bed admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.776577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 930/1853] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:27.776754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:27.778310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.789322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a7526-b2f0-4ace-be5e-593304d616a9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:27.793931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:27.794599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.794874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.795148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] PATH_INFO: `/v3/projects/5090f4e545474173b4f2aa12abd1c493/users/ba9f7b5dbe7248dfa67eccb78d1cebc5/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.797149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090f4e545474173b4f2aa12abd1c493, user_id=ba9f7b5dbe7248dfa67eccb78d1cebc5, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:27.799822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:27.810645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 924/1854] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:27 2022] PUT /identity/v3/projects/5090f4e545474173b4f2aa12abd1c493/users/ba9f7b5dbe7248dfa67eccb78d1cebc5/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:27.822053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:27.822339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:27.822624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:27.854661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] MFA Rules not processed for user `ba9f7b5dbe7248dfa67eccb78d1cebc5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:27.855896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:27.925698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 931/1855] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:27.938326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:27.941742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:28.007631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7c0f1-cf5f-457f-929d-2f00bb5561d7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:28.011469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:28.015134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:28.015134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:28.015134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:28.023558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:28.025127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:28.035852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 925/1856] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:28.193233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:28.204138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea58ec-2e9a-41e6-a290-fa115b94a0a8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:28.208043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:28.208701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:28.208986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:28.209262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:28.284252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:28.285811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00252c3d-2a4e-42ee-993d-1a1c44830b72 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:28.297782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 932/1857] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:28.808871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:28.872307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d3b5b-8c5b-4af4-baf4-35cca9f27aaf service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:28.878207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:28.878855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:28.879139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:28.879419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] PATH_INFO: `/v3/users/805303114f63467e876d9ccead36ff49` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:28.880604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805303114f63467e876d9ccead36ff49)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:28.882551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:29.078349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805303114f63467e876d9ccead36ff49'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:29.092408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:29.095338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805303114f63467e876d9ccead36ff49'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:29.096087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805303114f63467e876d9ccead36ff49'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:29.103575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805303114f63467e876d9ccead36ff49'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:29.189708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805303114f63467e876d9ccead36ff49'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:29.201499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 926/1858] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:28 2022] DELETE /identity/v3/users/805303114f63467e876d9ccead36ff49 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:29.205777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:29.206650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:29.207746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:29.242940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:29.255253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:29.324408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 933/1859] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:29.335077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:29.336971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:29.413466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573537-f614-4bf6-b94d-4176d1eec421 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:29.418949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:29.419581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:29.419860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:29.420132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:29.439788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:29.441454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:29.455321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 927/1860] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:29.557926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:29.632482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:29.634031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:29.675293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bcb2c-0790-4c50-a256-a48dcfcaac25 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:29.682866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:29.683548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:29.683993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:29.684523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] PATH_INFO: `/v3/users/2a1784b1ecbb4768bb3b2ec7004da5ef` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:29.686133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1784b1ecbb4768bb3b2ec7004da5ef)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:29.688150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:29.940364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1784b1ecbb4768bb3b2ec7004da5ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.026467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1784b1ecbb4768bb3b2ec7004da5ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.039143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:30.041716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.050705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1784b1ecbb4768bb3b2ec7004da5ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.051562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1784b1ecbb4768bb3b2ec7004da5ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.068757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11998d4-67fd-4ef2-aac9-a02bcd0db23b service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:30.068981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-25185860-e3a1-41d8-92ce-450c6ca835f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1784b1ecbb4768bb3b2ec7004da5ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.074379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:30.075132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.075550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.076130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] PATH_INFO: `/v3/projects/92d5d6da40af4e12b37c92c37c16da90` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.078121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d5d6da40af4e12b37c92c37c16da90)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:30.080539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:30.081856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 934/1861] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:29 2022] DELETE /identity/v3/users/2a1784b1ecbb4768bb3b2ec7004da5ef => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:30.084407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.084698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.084975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.112748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:30.114003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.185860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 935/1862] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:30.199535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:30.201429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.206869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d5d6da40af4e12b37c92c37c16da90', 'request_id': 'req-2be1256e-9082-49ed-8c02-9cf1981b1ec2'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.217593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d5d6da40af4e12b37c92c37c16da90', 'request_id': 'req-2be1256e-9082-49ed-8c02-9cf1981b1ec2'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.225164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d5d6da40af4e12b37c92c37c16da90', 'request_id': 'req-2be1256e-9082-49ed-8c02-9cf1981b1ec2'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.263583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5461f-7496-49ff-b7d1-ff5618502190 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:30.297061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] The token cache is being invalidate because project 92d5d6da40af4e12b37c92c37c16da90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:30.297334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.297978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.299770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 928/1863] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:30 2022] DELETE /identity/v3/projects/92d5d6da40af4e12b37c92c37c16da90 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:30.303612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:30.306914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.316073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:30.317081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.317464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.320793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.333562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.385736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1256e-9082-49ed-8c02-9cf1981b1ec2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:30.393798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:30.394483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.394759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.395028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] PATH_INFO: `/v3/users/ba9f7b5dbe7248dfa67eccb78d1cebc5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.396929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9f7b5dbe7248dfa67eccb78d1cebc5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:30.399339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:30.406357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:30.407921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:30.419048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 936/1864] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:30.420049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:30.421485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.438964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c35c38a-e784-4ccd-84fb-c66b0c79c5a7 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:30.444677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:30.448787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.448787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.448787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] PATH_INFO: `/v3/users/7c84b546e48b4e38a2e3e237d8cdbcce` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.448787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c84b546e48b4e38a2e3e237d8cdbcce)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:30.449208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:30.644629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9f7b5dbe7248dfa67eccb78d1cebc5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.660772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9f7b5dbe7248dfa67eccb78d1cebc5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.661862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9f7b5dbe7248dfa67eccb78d1cebc5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.670409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9f7b5dbe7248dfa67eccb78d1cebc5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.724754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c84b546e48b4e38a2e3e237d8cdbcce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.778291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9af21da9-f4d9-41ea-a97f-1dea1e22e224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9f7b5dbe7248dfa67eccb78d1cebc5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.786374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 929/1865] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:30 2022] DELETE /identity/v3/users/ba9f7b5dbe7248dfa67eccb78d1cebc5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:30.869017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c84b546e48b4e38a2e3e237d8cdbcce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.893868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c84b546e48b4e38a2e3e237d8cdbcce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.894630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c84b546e48b4e38a2e3e237d8cdbcce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.904191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c84b546e48b4e38a2e3e237d8cdbcce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:30.911491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 937/1866] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:30 2022] DELETE /identity/v3/users/7c84b546e48b4e38a2e3e237d8cdbcce => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:30.915884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:30.916500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:30.917085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:30.944294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:30.945737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:30.978683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:30.981767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:31.060270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 930/1867] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:31.074279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:31.077318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:31.139446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3daef7-cee1-45a1-8a8a-8c225756596d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:31.157055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:31.157717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:31.158134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:31.158415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] PATH_INFO: `/v3/projects/f7372f3c521d4d90816a00ad8e928750` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:31.159689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7372f3c521d4d90816a00ad8e928750)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:31.161657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:31.267754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c2a7b-6e01-432d-a1f1-b76cbc0af679 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:31.273717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:31.275583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:31.276223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:31.276223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:31.290134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:31.291934 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:31.303357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 931/1868] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:31.312496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:31.366398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7372f3c521d4d90816a00ad8e928750', 'request_id': 'req-3ad67f3a-46d0-4f90-b994-c50937a2fa28'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.478360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7372f3c521d4d90816a00ad8e928750', 'request_id': 'req-3ad67f3a-46d0-4f90-b994-c50937a2fa28'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.486558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7372f3c521d4d90816a00ad8e928750', 'request_id': 'req-3ad67f3a-46d0-4f90-b994-c50937a2fa28'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.499062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:31.500828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:31.502894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] The token cache is being invalidate because project f7372f3c521d4d90816a00ad8e928750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:31.503422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.504590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.507156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 938/1869] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:30 2022] DELETE /identity/v3/projects/f7372f3c521d4d90816a00ad8e928750 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:31.520344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:31.521172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b121795-f083-4d59-ba52-818b013d09d7 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:31.522273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:31.648751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:31.649739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:31.650023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:31.650299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] PATH_INFO: `/v3/projects/5090f4e545474173b4f2aa12abd1c493` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:31.651487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5090f4e545474173b4f2aa12abd1c493)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:31.653606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:31.674046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad67f3a-46d0-4f90-b994-c50937a2fa28 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:31.680469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:31.681516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:31.681848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:31.682167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] PATH_INFO: `/v3/users/849717be54704e44adf00e383d7843a2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:31.683355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849717be54704e44adf00e383d7843a2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:31.685403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:31.728857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:31.810884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5090f4e545474173b4f2aa12abd1c493', 'request_id': 'req-6ba1854a-ad56-4a74-bc87-0acb6d61475c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.818982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5090f4e545474173b4f2aa12abd1c493', 'request_id': 'req-6ba1854a-ad56-4a74-bc87-0acb6d61475c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.828938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5090f4e545474173b4f2aa12abd1c493', 'request_id': 'req-6ba1854a-ad56-4a74-bc87-0acb6d61475c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.969939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] The token cache is being invalidate because project 5090f4e545474173b4f2aa12abd1c493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:31.970481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.972191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ba1854a-ad56-4a74-bc87-0acb6d61475c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:31.979375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 932/1870] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:31 2022] DELETE /identity/v3/projects/5090f4e545474173b4f2aa12abd1c493 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:31.979375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102762-af24-4139-bd43-a70860e37568 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:31.979375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102762-af24-4139-bd43-a70860e37568 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:31.979644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102762-af24-4139-bd43-a70860e37568 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:31.981546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 933/1871] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:04:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:04:31.985392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849717be54704e44adf00e383d7843a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.003627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b43ec-e979-4386-9e47-078015b80868 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.004101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b43ec-e979-4386-9e47-078015b80868 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.004919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b43ec-e979-4386-9e47-078015b80868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.031617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-704b43ec-e979-4386-9e47-078015b80868 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:32.032970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-704b43ec-e979-4386-9e47-078015b80868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.105699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 934/1872] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:32.108404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.108694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.109495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.141394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849717be54704e44adf00e383d7843a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.147402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:32.149025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.161235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849717be54704e44adf00e383d7843a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.164096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849717be54704e44adf00e383d7843a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.180973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a0305aa5-b683-4675-a6fd-5cef857a17d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849717be54704e44adf00e383d7843a2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.194307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 939/1873] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:31 2022] DELETE /identity/v3/users/849717be54704e44adf00e383d7843a2 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:32.198624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.198914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.199190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.224245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:32.225975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.306693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 935/1874] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:32.307586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.310097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 940/1875] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:32.315153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.325002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447ae710-8e96-41f1-b3fc-6c399444e302 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.331436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.331523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.332011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.332345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.332622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.333294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:32.333601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.335192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.347354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c1135-9630-47c1-b5d2-2a8b02575d04 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.353014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 941/1876] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:32.353386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.354034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.354144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.354370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.357738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] PATH_INFO: `/v3/projects/51b42277f3654491a18e3a3ee47c7aed` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.357878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.357972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b42277f3654491a18e3a3ee47c7aed)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.358056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.436552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998f44-c6d7-4e48-b6ee-9d7d1f0b1275 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.442907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.444274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.444274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.444922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.454540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.456116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.467190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 942/1877] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:32.468090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.479565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abaf64-ecf6-4a32-8b55-5d25c5c258fc service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.485027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.485643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.485959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.486391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.487054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.489018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.536223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b42277f3654491a18e3a3ee47c7aed', 'request_id': 'req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.543398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b42277f3654491a18e3a3ee47c7aed', 'request_id': 'req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.554696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b42277f3654491a18e3a3ee47c7aed', 'request_id': 'req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.642001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] The token cache is being invalidate because project 51b42277f3654491a18e3a3ee47c7aed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:32.642765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.642982 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 943/1878] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:32 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:32.643963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.646307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 936/1879] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:32 2022] DELETE /identity/v3/projects/51b42277f3654491a18e3a3ee47c7aed => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:32.647321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.650065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.650879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.651678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.723830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:32.724170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49be0c-4d20-4780-bcde-1e0f74bca859 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.730647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6de3b-4a88-481f-a5cd-b66c8b6627fe admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.731862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.732509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.732791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.733138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.733708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.735666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.741931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.747817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.747817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.747817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] PATH_INFO: `/v3/users/15d297b579014909a9eaccfb652963e5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.747817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d297b579014909a9eaccfb652963e5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.749891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.834545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 944/1880] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:32 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:32.836719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:32.839046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:32.853397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916413a-7885-4074-9e41-d6d4151c6de1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:32.859597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:32.862743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:32.862743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:32.862743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] PATH_INFO: `/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:32.862743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac892ab3d494e139fb6667fcf5c9e85)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:32.864104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:32.992826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d297b579014909a9eaccfb652963e5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:32.996648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac892ab3d494e139fb6667fcf5c9e85', 'request_id': 'req-c911b91d-38bd-44ba-afac-336aaab37519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.005633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d297b579014909a9eaccfb652963e5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.006423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d297b579014909a9eaccfb652963e5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.013674 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d297b579014909a9eaccfb652963e5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.112118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac892ab3d494e139fb6667fcf5c9e85', 'request_id': 'req-c911b91d-38bd-44ba-afac-336aaab37519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.121720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac892ab3d494e139fb6667fcf5c9e85', 'request_id': 'req-c911b91d-38bd-44ba-afac-336aaab37519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.146623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] The token cache is being invalidate because project 3ac892ab3d494e139fb6667fcf5c9e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:33.147314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.148232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.150621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 945/1881] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:32 2022] DELETE /identity/v3/projects/3ac892ab3d494e139fb6667fcf5c9e85 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:33.151462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.153559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.209688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1592c093-3ea6-4bdf-9656-ab7c77c7755d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d297b579014909a9eaccfb652963e5'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:33.218804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 937/1882] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:32 2022] DELETE /identity/v3/users/15d297b579014909a9eaccfb652963e5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:33.219727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a672-649e-4fc8-99d9-28d1bb242927 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.220720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a672-649e-4fc8-99d9-28d1bb242927 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.220720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a672-649e-4fc8-99d9-28d1bb242927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.266756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-24a4a672-649e-4fc8-99d9-28d1bb242927 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:33.267937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-24a4a672-649e-4fc8-99d9-28d1bb242927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.285773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911b91d-38bd-44ba-afac-336aaab37519 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.368328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 938/1883] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:33.381187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.381187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.381187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.403701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:33.405327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.420734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 939/1884] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:33.428858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.443296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801c2e9-d6cf-4b0d-8368-a2bed0f43fe3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.448531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.449232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.449583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.449922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.450953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:33.451851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.455183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.457256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.459398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.461439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.461439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.461439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.464194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.472853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 940/1885] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:33.477929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.483596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 946/1886] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:33.488293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.493391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d0209-2461-47d7-8acf-e5a9c4e38d79 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.500622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.501377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.501755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.502098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.502816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.503129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca87229-7b5a-4294-b8ad-db7c76ff6da6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.505111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.508862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.509799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.511011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.511011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.511368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.513654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.528184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 947/1887] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:33.533395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.549937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89794be-6847-4f87-849e-65efe845942c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.566049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.567249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.567754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.568294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] PATH_INFO: `/v3/projects/5635ecdfc3d24ee087d13b80ab46b8b7/users/9eba9afbca41461d8acc4789905c0a11/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.595728 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5635ecdfc3d24ee087d13b80ab46b8b7, user_id=9eba9afbca41461d8acc4789905c0a11, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.598568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fd616-ac34-48ea-b603-6df5cd3323a4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.632592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 941/1888] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:33 2022] POST /identity/v3/projects => generated 369 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:33.637429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.754331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9ca90-f0a7-4d61-be41-f57f05194f19 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.763257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 948/1889] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:33 2022] PUT /identity/v3/projects/5635ecdfc3d24ee087d13b80ab46b8b7/users/9eba9afbca41461d8acc4789905c0a11/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:33.778041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.779095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.781694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.821880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] MFA Rules not processed for user `9eba9afbca41461d8acc4789905c0a11`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:33.823213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.833739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.834377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.835271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.835690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.836421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.838503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.931196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 949/1890] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:33.932511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.933927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.948122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 942/1891] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:33 2022] POST /identity/v3/users => generated 285 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:33.949123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.949759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a9745-9f55-4330-abd1-e24f117c72a8 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.951451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.955284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.955996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.956316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.956595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] PATH_INFO: `/v3/projects/effb399bb0e74be49aa0c87b23d0c163` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.957731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effb399bb0e74be49aa0c87b23d0c163)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.959682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.009550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e0ad-4d2e-4b20-a900-5e3cd23d19ca admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.013430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.014031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.014311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.014580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.024001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.025520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.035097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 943/1892] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:34.036056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.046473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7bae4-3725-495a-aa0f-7dbabace1e18 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.051571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.052184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.052497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.052772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.053516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.055102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.065820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 944/1893] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:34.066709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.076623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81dbde-971e-455f-9dfb-3011506b01c8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.079021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effb399bb0e74be49aa0c87b23d0c163', 'request_id': 'req-12533967-c833-4455-975b-f9b0eea8adc1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.092443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.140858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.141422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.141738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.142060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] PATH_INFO: `/v3/users/9eba9afbca41461d8acc4789905c0a11` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.143176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eba9afbca41461d8acc4789905c0a11)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.145209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.160394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effb399bb0e74be49aa0c87b23d0c163', 'request_id': 'req-12533967-c833-4455-975b-f9b0eea8adc1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.167126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effb399bb0e74be49aa0c87b23d0c163', 'request_id': 'req-12533967-c833-4455-975b-f9b0eea8adc1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.179158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] The token cache is being invalidate because project effb399bb0e74be49aa0c87b23d0c163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:34.179444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.180251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.181730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 950/1894] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:33 2022] DELETE /identity/v3/projects/effb399bb0e74be49aa0c87b23d0c163 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:34.184334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.184334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.197172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533967-c833-4455-975b-f9b0eea8adc1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.202053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.202653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.204495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.204495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.204495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.206002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce093f-b02a-4c5d-b26b-a878891f5272 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.216271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 951/1895] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:34.217642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03662-8696-4528-b70e-90d192519216 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.218905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03662-8696-4528-b70e-90d192519216 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.218905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d03662-8696-4528-b70e-90d192519216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.238525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-72d03662-8696-4528-b70e-90d192519216 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:34.250476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-72d03662-8696-4528-b70e-90d192519216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.250476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 952/1896] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:34.250476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03662-8696-4528-b70e-90d192519216 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.259558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d03662-8696-4528-b70e-90d192519216 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.264262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.264917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.265340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.265633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] PATH_INFO: `/v3/projects/96e76dc9f80c4119b3251f8189c50b9d/users/ad7b8d27d9d840f58c1543aacc746ccc/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.280535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e76dc9f80c4119b3251f8189c50b9d, user_id=ad7b8d27d9d840f58c1543aacc746ccc, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.283180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e4596-f102-4ddd-b8e5-0d11ab27d826 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.465030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 953/1897] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:34 2022] PUT /identity/v3/projects/96e76dc9f80c4119b3251f8189c50b9d/users/ad7b8d27d9d840f58c1543aacc746ccc/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:34.467142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead1ab-96ec-445c-a0b0-377f87011f1b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.467745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead1ab-96ec-445c-a0b0-377f87011f1b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.468310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbead1ab-96ec-445c-a0b0-377f87011f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.496079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bbead1ab-96ec-445c-a0b0-377f87011f1b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:34.497647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bbead1ab-96ec-445c-a0b0-377f87011f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.543114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eba9afbca41461d8acc4789905c0a11'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.558477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eba9afbca41461d8acc4789905c0a11'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.560509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eba9afbca41461d8acc4789905c0a11'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.570879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 954/1898] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:34.573612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d057-9f48-46ac-92c6-50286944654a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.573904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d057-9f48-46ac-92c6-50286944654a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.574189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6d057-9f48-46ac-92c6-50286944654a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.577673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eba9afbca41461d8acc4789905c0a11'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.610715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bdd6d057-9f48-46ac-92c6-50286944654a None None] MFA Rules not processed for user `ad7b8d27d9d840f58c1543aacc746ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:34.612529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bdd6d057-9f48-46ac-92c6-50286944654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.632387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.700376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eba9afbca41461d8acc4789905c0a11'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:34.711487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 945/1899] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:34 2022] DELETE /identity/v3/users/9eba9afbca41461d8acc4789905c0a11 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:34.712807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 955/1900] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:34.716038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.716434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.716720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.722179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.738871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:34.740109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.807404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a725cdd-c0c8-4742-981a-b64b5e7e6045 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.829915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.830566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.834252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.834252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.834927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:34.835249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.839957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 956/1901] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:34.840073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.840863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.842163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:34.856549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 946/1902] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:34.857890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9acebe-1f4f-49a9-86a4-15bbe3550620 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.860726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:34.863323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.868923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.868923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.868923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.868923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.868923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.876222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b3b41-bf2e-47a2-9893-ee926a34b6f9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:34.881435 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:34.881991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:34.882273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:34.882560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:34.883204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:34.885284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:34.999246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 947/1903] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:35.001718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 957/1904] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:34 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:35.003390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.004482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.006891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:35.081330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d46a1-b923-4634-a812-c2bfd67eb76d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.097256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa4475-f66e-47c9-a8f0-82425fbe3292 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.103319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.103945 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.104257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.104537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.105202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.107182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.136545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.137165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.138330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.138330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.147087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.148569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.158128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 948/1905] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:35.158923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.168508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c321-f2a2-4a5c-bf8c-914840030392 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.175042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.175042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.175042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.175042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.175610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.178417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.293679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 949/1906] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:35 2022] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:35.293794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 958/1907] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:35 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:35.294369 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.295141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.306354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a7d32-9065-45bb-a8e5-1274f8efd117 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.308077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02569a95-7a35-443f-9c65-44fc3906a616 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.311262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.311879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.312820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.313312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.313420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.313966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.314067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.314255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.314526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.315161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.315546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.316767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.327319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 959/1908] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:35.327319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.331740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:35.331831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 950/1909] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:35.333174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.341417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc64be-fb07-4936-8dab-50b84caf5b01 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.343191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42c357-0c8b-447d-9db8-2cad477d9c75 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.346575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.347295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.347511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.347778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] PATH_INFO: `/v3/users/576ee37425a442b7b7f8c0599a419834` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.348735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.348907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=576ee37425a442b7b7f8c0599a419834)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.349443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.349713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.349985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] PATH_INFO: `/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed/users/158ffe0df2d744f1afae1f613064329c/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.350800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.367990 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a8f60e7aa448afa2c4b983d552d0ed, user_id=158ffe0df2d744f1afae1f613064329c, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.370916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.559142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 951/1910] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:35 2022] PUT /identity/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed/users/158ffe0df2d744f1afae1f613064329c/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:35.559142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.637808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69f34f-e34a-436e-b3f9-fbd2734c7c97 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.646474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.647094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.647377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.647653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.648377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.650022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.663496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 952/1911] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:35.664181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.676007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f47970-5dcb-457a-834a-4c9ccdf6e23f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.691535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.692572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.693340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.694322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.695294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.697102 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.701226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576ee37425a442b7b7f8c0599a419834'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:35.712279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 953/1912] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:35.712279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.730779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa030d65-cdb8-4461-b3bc-8b073b6aaf9f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.738333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.739019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.739303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.739578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] PATH_INFO: `/v3/projects/62034ffd262f40a19690e4bac3cd675f/users/6b797dae4f4542c88edd4177635e71c6/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.755700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62034ffd262f40a19690e4bac3cd675f, user_id=6b797dae4f4542c88edd4177635e71c6, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.758394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6629665-5241-430a-b7ba-ecae79ec9adb admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.794657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576ee37425a442b7b7f8c0599a419834'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:35.808079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576ee37425a442b7b7f8c0599a419834'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:35.808776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576ee37425a442b7b7f8c0599a419834'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:35.816398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576ee37425a442b7b7f8c0599a419834'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:35.822507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 960/1913] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:35 2022] DELETE /identity/v3/users/576ee37425a442b7b7f8c0599a419834 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:35.823262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.824640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:35.896013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad70dd7-64c6-49fc-9751-ee33a4edf631 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:35.901475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:35.914221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.914221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.914221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] PATH_INFO: `/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed/users/158ffe0df2d744f1afae1f613064329c/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.914221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a8f60e7aa448afa2c4b983d552d0ed, user_id=158ffe0df2d744f1afae1f613064329c, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:35.914221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:35.919233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 961/1914] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:35 2022] PUT /identity/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed/users/158ffe0df2d744f1afae1f613064329c/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:35.932041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:35.933718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:35.971563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 954/1915] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:35 2022] PUT /identity/v3/projects/62034ffd262f40a19690e4bac3cd675f/users/6b797dae4f4542c88edd4177635e71c6/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:35.971563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa7be-e680-4e4a-a548-4392027d0754 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:35.971563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa7be-e680-4e4a-a548-4392027d0754 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:35.971563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912aa7be-e680-4e4a-a548-4392027d0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:35.984970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-912aa7be-e680-4e4a-a548-4392027d0754 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:35.986222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-912aa7be-e680-4e4a-a548-4392027d0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.018796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dba1eb-b0f5-4cf1-a0dc-4c591de3b6a3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:36.076793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 955/1916] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:36.076793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd166e-252b-4215-951e-36c6bc7909e8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.076793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd166e-252b-4215-951e-36c6bc7909e8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.076793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd166e-252b-4215-951e-36c6bc7909e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.103669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:36.104379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.104723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.105002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] PATH_INFO: `/v3/projects/5635ecdfc3d24ee087d13b80ab46b8b7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.106614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5635ecdfc3d24ee087d13b80ab46b8b7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:36.108983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:36.122179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8dfd166e-252b-4215-951e-36c6bc7909e8 None None] MFA Rules not processed for user `158ffe0df2d744f1afae1f613064329c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:36.123950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8dfd166e-252b-4215-951e-36c6bc7909e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.222587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 956/1917] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:36.223296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40709dd-751b-41fa-a116-781210d1129a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.223642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40709dd-751b-41fa-a116-781210d1129a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.224298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40709dd-751b-41fa-a116-781210d1129a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.258340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f40709dd-751b-41fa-a116-781210d1129a None None] MFA Rules not processed for user `6b797dae4f4542c88edd4177635e71c6`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:36.268463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f40709dd-751b-41fa-a116-781210d1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.268602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5635ecdfc3d24ee087d13b80ab46b8b7', 'request_id': 'req-442a46f3-6b36-4888-83db-3b543981598e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:36.332973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 957/1918] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:36.333971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40709dd-751b-41fa-a116-781210d1129a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:36.335324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f40709dd-751b-41fa-a116-781210d1129a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.392098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40709dd-751b-41fa-a116-781210d1129a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:36.396011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:36.396804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.397215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.397617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.429651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5635ecdfc3d24ee087d13b80ab46b8b7', 'request_id': 'req-442a46f3-6b36-4888-83db-3b543981598e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:36.457958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5635ecdfc3d24ee087d13b80ab46b8b7', 'request_id': 'req-442a46f3-6b36-4888-83db-3b543981598e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:36.472071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] The token cache is being invalidate because project 5635ecdfc3d24ee087d13b80ab46b8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:36.472684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:36.473756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:36.473897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:36.475491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:36.475775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 962/1919] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:35 2022] DELETE /identity/v3/projects/5635ecdfc3d24ee087d13b80ab46b8b7 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:36.480527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:36.482468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.487324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 958/1920] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:36.488258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:36.489817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.503036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa3411-3c7b-4aa9-ac98-88eb69598f29 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:36.508057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:36.508730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.509169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.509468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.510161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:36.512263 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:36.558664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:36.600883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a46f3-6b36-4888-83db-3b543981598e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:36.605164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:36.605966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.606255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.606531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.610801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.686587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:36.688576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83f143-8aa0-4013-9550-c851e181ff52 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:36.698819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 963/1921] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:36.700178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac898-ad64-41ba-bf14-90286d5ac33c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.700506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac898-ad64-41ba-bf14-90286d5ac33c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.700906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eac898-ad64-41ba-bf14-90286d5ac33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.720147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 959/1922] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:36.722105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-32eac898-ad64-41ba-bf14-90286d5ac33c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:36.723394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-32eac898-ad64-41ba-bf14-90286d5ac33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.734479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:36.736475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.816439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 964/1923] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:36.825413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.825930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.826404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.855729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ec9fa-708e-4be4-b3d9-c85d83bac5c6 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:36.869347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:36.870039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:36.870330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:36.871330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:36.872243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:36.876690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:36.879480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:36.880526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.890134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 965/1924] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:36.892741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:36.895290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:36.985155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 960/1925] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:36 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:36.985155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.017947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7e518-ceb2-4a8d-ba93-951c6c4b863a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.029555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9498-a368-4824-9fb2-a4456734999d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.031439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.032379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.033077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.033835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.035462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:37.036163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.038020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.040431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.040882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.041257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.041608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.048430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:37.071218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 961/1926] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:37.072334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.112960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162004a-5acd-47eb-855c-2b6469426c84 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.138020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.138764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.139116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.139481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.140266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.144297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.175631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 962/1927] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:37.177340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.190517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9208fd-6f0f-4b77-9937-89fdf6c9f91d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.206388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.207309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.207831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.208265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.209045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.211473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.221073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:37.235938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.237439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.253492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 966/1928] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:37.254364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.267632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8b1a-2b49-41de-bf2c-1dd02ce53b26 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.272536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.273155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.273931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.273931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.274370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.276832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.292251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 967/1929] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:37.293557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.308297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c351c8-d7ad-40f8-bbf0-792d567c2f10 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.314195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.319423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.319423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.319423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] PATH_INFO: `/v3/projects/012c4f017ab34f039c5d7e6f1502af8a/users/cd1b7bc463c44863a2613742fa1903ca/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.338195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012c4f017ab34f039c5d7e6f1502af8a, user_id=cd1b7bc463c44863a2613742fa1903ca, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.341382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a9364-6cd2-406b-869d-23bdf924be03 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.357937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 963/1930] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:37 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:37.361796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.449543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 968/1931] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:37 2022] PUT /identity/v3/projects/012c4f017ab34f039c5d7e6f1502af8a/users/cd1b7bc463c44863a2613742fa1903ca/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:37.462639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b673-8045-4950-b62e-654af4836c6e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.462836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b673-8045-4950-b62e-654af4836c6e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.468462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59b673-8045-4950-b62e-654af4836c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.487256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62d4f7-061d-45c2-a477-b95e8a28572f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.543041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-be59b673-8045-4950-b62e-654af4836c6e None None] MFA Rules not processed for user `cd1b7bc463c44863a2613742fa1903ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:37.548251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-be59b673-8045-4950-b62e-654af4836c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:37.604026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.604872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.605255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.605632 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.606374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.608725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.689933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 969/1932] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:37.694765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b673-8045-4950-b62e-654af4836c6e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.710438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59b673-8045-4950-b62e-654af4836c6e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.717410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.717811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.722176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.722176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.722176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.722176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.757106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 964/1933] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:37 2022] POST /identity/v3/users => generated 288 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:37.757899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.768454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8dc4-635c-45a4-b100-0ca204c11b19 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.773680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.774304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.774617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.774890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.775545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.777365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.787707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 965/1934] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:37.791699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.801340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63cda7-1f16-45f7-a211-89ae976c33f8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.805835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.806525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.806807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.807085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.807706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.809304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.821642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 966/1935] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:37.826371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.837176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986cd2a2-4598-4d51-a96a-113b10169d96 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.841986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.847291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.847291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.847291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] PATH_INFO: `/v3/projects/a7a058db699e49f5b889118c29c5b2ee/users/4ebe906fa85f4f7cb48ecfaf35b14ca8/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.860808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a058db699e49f5b889118c29c5b2ee, user_id=4ebe906fa85f4f7cb48ecfaf35b14ca8, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.863823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:37.869442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 970/1936] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:37 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:37.869709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:37.944450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d2082-d50e-48d6-ad2e-c59a978899fc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:37.950759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:37.951443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:37.951863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:37.952034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:37.952681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:37.955242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37570c52-1ee0-49ba-ab24-7bdf40950342 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.005154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 967/1937] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:37 2022] PUT /identity/v3/projects/a7a058db699e49f5b889118c29c5b2ee/users/4ebe906fa85f4f7cb48ecfaf35b14ca8/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:38.005868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.007510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:38.047609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 971/1938] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:37 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:38.048738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.049131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.049535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.083567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] MFA Rules not processed for user `4ebe906fa85f4f7cb48ecfaf35b14ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:38.085314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:38.088638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f8ba7-6919-49cc-b345-3af5db6dd27d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.094194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.094836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.095120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.095397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] PATH_INFO: `/v3/projects/cfd026864f654065a3401de305e2aa20` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.096628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd026864f654065a3401de305e2aa20)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.102591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.179472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 972/1939] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:38.179472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.194012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bc610-9d9f-4e8c-87ee-57151a9016ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.209107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.211404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.211915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.212370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.213854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.216537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.230967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 973/1940] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:38.233296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.261130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd026864f654065a3401de305e2aa20', 'request_id': 'req-e1e7baa4-f044-488f-bf29-e2db475641f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.269231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd026864f654065a3401de305e2aa20', 'request_id': 'req-e1e7baa4-f044-488f-bf29-e2db475641f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.277720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:38.288127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd026864f654065a3401de305e2aa20', 'request_id': 'req-e1e7baa4-f044-488f-bf29-e2db475641f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.312256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2b454-d696-4bbe-8b95-11107196e324 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.365852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.366469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.366771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.367032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.372047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] The token cache is being invalidate because project cfd026864f654065a3401de305e2aa20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:38.378425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.378425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.378425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 968/1941] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:38 2022] DELETE /identity/v3/projects/cfd026864f654065a3401de305e2aa20 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:38.378425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.378425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:38.430245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.431813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.442121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 974/1942] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:38.443185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.454726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7baa4-f044-488f-bf29-e2db475641f7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.457516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dea635-2bcb-406d-863a-f566eda26ed0 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.459946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.463382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.463382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.463382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] PATH_INFO: `/v3/projects/0b04a729f5ab438f8ce4a62ec5056201/users/542058a9a79844b9b47b2148f006cab0/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.463631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.466237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.467010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.467665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] PATH_INFO: `/v3/users/1c7d61e631164c2c8d75080b2081b154` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.469667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c7d61e631164c2c8d75080b2081b154)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.472339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.482005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b04a729f5ab438f8ce4a62ec5056201, user_id=542058a9a79844b9b47b2148f006cab0, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.485665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.590693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 969/1943] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:38 2022] PUT /identity/v3/projects/0b04a729f5ab438f8ce4a62ec5056201/users/542058a9a79844b9b47b2148f006cab0/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:38.595678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.708451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c6fec-2ee0-411a-a978-7df18e2a87e2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.714329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.714947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.715231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.715490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.717673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.719976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.734313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 970/1944] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:38.737348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.743819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:38.748351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299933db-f9dc-485c-8fda-3a6e59f926f8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:38.753428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:38.754100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.754382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.754658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] PATH_INFO: `/v3/projects/0b04a729f5ab438f8ce4a62ec5056201/users/542058a9a79844b9b47b2148f006cab0/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.757050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b04a729f5ab438f8ce4a62ec5056201, user_id=542058a9a79844b9b47b2148f006cab0, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:38.760251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b45ac-39a6-40cf-99a6-92d0b5f2f5fa admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:38.771736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 971/1945] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:38 2022] PUT /identity/v3/projects/0b04a729f5ab438f8ce4a62ec5056201/users/542058a9a79844b9b47b2148f006cab0/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:38.783561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:38.783862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:38.784118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:38.799966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c7d61e631164c2c8d75080b2081b154'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.815044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] MFA Rules not processed for user `542058a9a79844b9b47b2148f006cab0`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:38.816399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:38.887476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 972/1946] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:38.897739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c7d61e631164c2c8d75080b2081b154'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.899922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:38.904567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:38.913553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c7d61e631164c2c8d75080b2081b154'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.914284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c7d61e631164c2c8d75080b2081b154'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.922197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c7d61e631164c2c8d75080b2081b154'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:38.932455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 975/1947] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:38 2022] DELETE /identity/v3/users/1c7d61e631164c2c8d75080b2081b154 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:38.976232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502238-066c-421e-9ac9-5176c78ed3c2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:39.020539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:39.021634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:39.021966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:39.022187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:39.024089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:39.095142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:39.096619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:39.106279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 973/1948] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:39.256694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:39.258090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:39.274299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395eb52-8b07-4257-908f-aa20b1ed4f99 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:39.278943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:39.279573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:39.279857 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:39.280176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:39.282687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:39.348882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:39.350623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f775860-361a-4e2d-a31c-a7fe01b51f73 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:39.359543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 976/1949] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:39.486476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:39.488269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:39.602439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4a64f-dc68-4b30-a97c-82a5b3d8cf38 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:39.607267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:39.607944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:39.608284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:39.608587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] PATH_INFO: `/v3/projects/05166f4406c744d780c80531cdc38b05` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:39.610347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=05166f4406c744d780c80531cdc38b05)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:39.612284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:39.769388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05166f4406c744d780c80531cdc38b05', 'request_id': 'req-24e343d2-ff85-425a-b3a7-3d20cb41bccc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:39.776538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05166f4406c744d780c80531cdc38b05', 'request_id': 'req-24e343d2-ff85-425a-b3a7-3d20cb41bccc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:39.783077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05166f4406c744d780c80531cdc38b05', 'request_id': 'req-24e343d2-ff85-425a-b3a7-3d20cb41bccc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:39.917492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] The token cache is being invalidate because project 05166f4406c744d780c80531cdc38b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:39.917793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:39.918441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-24e343d2-ff85-425a-b3a7-3d20cb41bccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:39.920137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 974/1950] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:39 2022] DELETE /identity/v3/projects/05166f4406c744d780c80531cdc38b05 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:39.925121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:39.925604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:39.925707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:39.968121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:39.969552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:40.046058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 977/1951] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:40.054078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.054352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.054626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.088057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:40.089558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:40.100323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 975/1952] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:40.104570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.114403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb246-4c85-44ab-9a94-0d9b6073e22d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.121358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.122336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.122745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.123089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.123957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:40.124374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.126593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.144471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 978/1953] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:40.149088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.160710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8ad3b-a7e4-45c0-813b-014d69d2ee79 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.170151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.170781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.171125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.171391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.176602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.176602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.308376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 976/1954] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:40.308478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.318125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989fbc7-38b9-46c3-86f2-5f6861098f72 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.384575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.385276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.385630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.385979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.386723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.388823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.571279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 979/1955] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/users => generated 281 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:40.575845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.587405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b560732-901f-4bbc-afb6-dc027434f211 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.592973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.594116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.603183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.603183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.603183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.603183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.621665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 977/1956] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:40.626407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.649844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed8585-240a-4701-9a4c-e243e1072091 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.657284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.659440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.659440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.660037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.662777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.664524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d066ea-30bf-4cf7-ab2b-fffa23b2df5a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.676415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 980/1957] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:40.681113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:40.692501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e91a-0330-4ff6-baa0-3a2c6937aecb admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:40.697819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:40.698490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.698774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.699267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] PATH_INFO: `/v3/projects/85790368569045bba21dda7303443f10/users/3082ae95fd274d6d80a16b1162f0f83f/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.715942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85790368569045bba21dda7303443f10, user_id=3082ae95fd274d6d80a16b1162f0f83f, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:40.719221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:40.853825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 978/1958] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:40 2022] PUT /identity/v3/projects/85790368569045bba21dda7303443f10/users/3082ae95fd274d6d80a16b1162f0f83f/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:40.864549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.865041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.865371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.894973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] MFA Rules not processed for user `3082ae95fd274d6d80a16b1162f0f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:40.896294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:40.955249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:40.994853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 981/1959] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:40.999464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.069813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51a59f-16fb-4246-8dd2-620f176b37d4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.075800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.076461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.076752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.077028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.077685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.082001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.200838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 979/1960] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:41.205130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.217419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822eed20-90e2-4510-aec3-012db7813a9a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.271319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:41.283953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.284820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.284942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.285641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.285811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.288085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.369838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 982/1961] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:41 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:41.373957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.386474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a945-8fa8-4dab-b51e-e6a3455f4096 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.392748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.393485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.393765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.394064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.394706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.397081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.407430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 980/1962] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:41.411668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.421825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9563f-f246-48c7-83e2-f09623ea1eec admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.426991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.427700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.427983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.428278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] PATH_INFO: `/v3/projects/b0d0bfc986fa459b93655d1aa737b47c/users/e4117d07103d42f3a4bff0158923b043/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.444246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d0bfc986fa459b93655d1aa737b47c, user_id=e4117d07103d42f3a4bff0158923b043, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.447326 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.524061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 983/1963] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:41 2022] PUT /identity/v3/projects/b0d0bfc986fa459b93655d1aa737b47c/users/e4117d07103d42f3a4bff0158923b043/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:41.528299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.539219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd1244-cf95-476c-bb9f-11475931fcfe admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.619437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.619437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.619437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.619437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.619809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.619809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37743b5d-9d6c-448b-b897-627960658e34 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.623627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 981/1964] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:41.629519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.641017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3204fa-9d06-4709-bc3f-9441be062a1b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.645990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.646753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.647046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.651564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] PATH_INFO: `/v3/projects/b0d0bfc986fa459b93655d1aa737b47c/users/e4117d07103d42f3a4bff0158923b043/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.651564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d0bfc986fa459b93655d1aa737b47c, user_id=e4117d07103d42f3a4bff0158923b043, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.652152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.669820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 984/1965] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:41 2022] PUT /identity/v3/projects/b0d0bfc986fa459b93655d1aa737b47c/users/e4117d07103d42f3a4bff0158923b043/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:41.679845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e178-1315-4c9d-b607-260df0498885 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.680140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e178-1315-4c9d-b607-260df0498885 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.680472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e178-1315-4c9d-b607-260df0498885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.711520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e229e178-1315-4c9d-b607-260df0498885 None None] MFA Rules not processed for user `e4117d07103d42f3a4bff0158923b043`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:41.712862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e229e178-1315-4c9d-b607-260df0498885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:41.783874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 982/1966] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:41.795039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.797362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:41.866185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084d172-d619-4b84-839f-f41f4d37f66f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.871298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.872469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.872747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.873016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.886036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.887573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.899736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 985/1967] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:42.242514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e178-1315-4c9d-b607-260df0498885 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:42.244107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e229e178-1315-4c9d-b607-260df0498885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:42.257592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e178-1315-4c9d-b607-260df0498885 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:42.265016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:42.266078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:42.266573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:42.269706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:42.336999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:42.339145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957043c4-a367-43cf-9622-abbdc31739d4 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:42.348603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 983/1968] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:43.413830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:43.666591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:45.165062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:45.167129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:45.271510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff95bc-9271-41e6-8f29-c9feb666f5a9 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:45.276405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:45.277177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:45.277464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:45.277741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] PATH_INFO: `/v3/users/ad7b8d27d9d840f58c1543aacc746ccc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:45.279176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7b8d27d9d840f58c1543aacc746ccc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:45.281707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:45.529776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:45.614582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7b8d27d9d840f58c1543aacc746ccc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:45.778366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7b8d27d9d840f58c1543aacc746ccc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:45.793474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7b8d27d9d840f58c1543aacc746ccc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:45.794191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7b8d27d9d840f58c1543aacc746ccc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:45.803276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7b8d27d9d840f58c1543aacc746ccc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:45.810865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 986/1969] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:45 2022] DELETE /identity/v3/users/ad7b8d27d9d840f58c1543aacc746ccc => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:45.815340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:45.815706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:45.816049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:45.835942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:45.844456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:45.902059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 984/1970] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:45.932884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:45.934444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:45.993667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec2fc5-339e-4bc7-9191-64dc88f2b3bb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:45.997593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:45.998233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:45.998483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:45.998757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.008580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.010335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:46.019975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 987/1971] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:46.053362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:46.151817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:46.153450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.166290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32004861-1d71-4d64-be15-ec86b90216ed None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:46.171066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:46.171676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.172658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.172928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] PATH_INFO: `/v3/users/4ebe906fa85f4f7cb48ecfaf35b14ca8` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.174148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebe906fa85f4f7cb48ecfaf35b14ca8)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.176092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:46.395363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebe906fa85f4f7cb48ecfaf35b14ca8'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.411419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebe906fa85f4f7cb48ecfaf35b14ca8'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.412340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebe906fa85f4f7cb48ecfaf35b14ca8'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.421460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebe906fa85f4f7cb48ecfaf35b14ca8'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.484022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:46.486657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.502283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd17ea66-0cc6-4ce5-94e5-356f184692d1 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:46.508633 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e04e4789-e255-4636-8f4f-0174c898c5b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebe906fa85f4f7cb48ecfaf35b14ca8'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.514077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:46.518021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 985/1972] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:46 2022] DELETE /identity/v3/users/4ebe906fa85f4f7cb48ecfaf35b14ca8 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:46.518274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.518361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.518699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] PATH_INFO: `/v3/projects/96e76dc9f80c4119b3251f8189c50b9d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.522441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.523039 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.523756 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.525809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e76dc9f80c4119b3251f8189c50b9d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.529025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:46.551986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:46.551986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.616103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 986/1973] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:46.628331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:46.630419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.697660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e76dc9f80c4119b3251f8189c50b9d', 'request_id': 'req-465bd318-5085-4afc-925f-a4a59868011a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.704476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb4f4c-5aa1-49ad-b1dd-1b05538a3e7d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:46.768528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:46.769178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.769595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.770095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.792668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e76dc9f80c4119b3251f8189c50b9d', 'request_id': 'req-465bd318-5085-4afc-925f-a4a59868011a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.801322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e76dc9f80c4119b3251f8189c50b9d', 'request_id': 'req-465bd318-5085-4afc-925f-a4a59868011a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.816436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] The token cache is being invalidate because project 96e76dc9f80c4119b3251f8189c50b9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:46.816648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.817314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:46.819172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 988/1974] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:46 2022] DELETE /identity/v3/projects/96e76dc9f80c4119b3251f8189c50b9d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:46.823280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:46.824529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.838151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.839711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:46.851950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 987/1975] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:46.899105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd318-5085-4afc-925f-a4a59868011a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:46.900071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:46.901561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:46.907296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:46.907904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.908190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.908495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] PATH_INFO: `/v3/users/158ffe0df2d744f1afae1f613064329c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.909971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158ffe0df2d744f1afae1f613064329c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.912343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:46.915909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd3b95-3a91-4b08-9365-e773941bf76e service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:46.936653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:46.937458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:46.937758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:46.938106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] PATH_INFO: `/v3/users/6b797dae4f4542c88edd4177635e71c6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:46.939559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b797dae4f4542c88edd4177635e71c6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:46.941877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:47.122937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158ffe0df2d744f1afae1f613064329c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.158112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b797dae4f4542c88edd4177635e71c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.174818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b797dae4f4542c88edd4177635e71c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.175726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b797dae4f4542c88edd4177635e71c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.184139 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b797dae4f4542c88edd4177635e71c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.219414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158ffe0df2d744f1afae1f613064329c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.235405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158ffe0df2d744f1afae1f613064329c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.236254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158ffe0df2d744f1afae1f613064329c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.243797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6305948b-98a3-45d9-bd1d-475df07ff9d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158ffe0df2d744f1afae1f613064329c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.257491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 989/1976] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:46 2022] DELETE /identity/v3/users/158ffe0df2d744f1afae1f613064329c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:47.310227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b797dae4f4542c88edd4177635e71c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.317573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 988/1977] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:46 2022] DELETE /identity/v3/users/6b797dae4f4542c88edd4177635e71c6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:47.322476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:47.322766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:47.323153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:47.342726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:47.344631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.361910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:47.363693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.436371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 990/1978] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:47.437835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:47.439267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.451927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebafa75-d6fe-4153-bb4a-ab79637a95fc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:47.457755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:47.458387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:47.458672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:47.458949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] PATH_INFO: `/v3/users/3082ae95fd274d6d80a16b1162f0f83f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:47.460075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3082ae95fd274d6d80a16b1162f0f83f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:47.462031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:47.463326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f86daa-fe46-4a81-a733-424130d7e657 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:47.468870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:47.469570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:47.469869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:47.470127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] PATH_INFO: `/v3/projects/a7a058db699e49f5b889118c29c5b2ee` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:47.471240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a058db699e49f5b889118c29c5b2ee)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:47.473203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:47.692665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a058db699e49f5b889118c29c5b2ee', 'request_id': 'req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.696904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3082ae95fd274d6d80a16b1162f0f83f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.705578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a058db699e49f5b889118c29c5b2ee', 'request_id': 'req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.713880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a058db699e49f5b889118c29c5b2ee', 'request_id': 'req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.799741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:47.800634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3082ae95fd274d6d80a16b1162f0f83f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.815449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3082ae95fd274d6d80a16b1162f0f83f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.816393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3082ae95fd274d6d80a16b1162f0f83f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.826431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3082ae95fd274d6d80a16b1162f0f83f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.835701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 991/1979] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:47 2022] DELETE /identity/v3/users/3082ae95fd274d6d80a16b1162f0f83f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:47.836776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:47.839249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.897234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] The token cache is being invalidate because project a7a058db699e49f5b889118c29c5b2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:47.897593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.898409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:47.900890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 989/1980] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:47 2022] DELETE /identity/v3/projects/a7a058db699e49f5b889118c29c5b2ee => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:47.902389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:47.903829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.921227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6686e1dc-dae5-48e5-9194-de8de8d0e180 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:47.925957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:47.926746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:47.930438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:47.930438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:47.930438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:47.990719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9cc6c6-178a-4ed8-a3e2-14de5c53af8f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.017628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.019754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa87a00-966c-4517-b47c-21ed0b03a126 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.032359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 992/1981] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:48.033634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a531b-b625-460f-96ac-ed7128d6d998 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.033999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a531b-b625-460f-96ac-ed7128d6d998 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.034347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a531b-b625-460f-96ac-ed7128d6d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.060684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d95a531b-b625-460f-96ac-ed7128d6d998 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:48.062196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d95a531b-b625-460f-96ac-ed7128d6d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.062887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.063646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.064049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.064432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] PATH_INFO: `/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.065679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a8f60e7aa448afa2c4b983d552d0ed)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.067664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.073486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 993/1982] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:48.075395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.075750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.076179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.101636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:48.102961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.111269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 994/1983] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:48.112647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.114051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.127922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3153d3-5e9c-4977-83dc-8b633b6bec1f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.132122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.132783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.133061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.133340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.155294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.158329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f31c7-70a5-478a-a16f-3291b8a2d39f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.175526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 995/1984] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:48.177045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.177436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.177842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.198381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:48.199615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.209513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 996/1985] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:48.215772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.225983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e62d9a-1163-4ae2-b651-ef75abee52c2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.228180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a8f60e7aa448afa2c4b983d552d0ed', 'request_id': 'req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:48.236296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a8f60e7aa448afa2c4b983d552d0ed', 'request_id': 'req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:48.242235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a8f60e7aa448afa2c4b983d552d0ed', 'request_id': 'req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:48.264402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:48.288874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.289521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.289809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.290087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.290738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:48.291074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.292708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.307202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 997/1986] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:48.312013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.322791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053e40c-c9c1-47ac-8036-e07ea745a73c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.327641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.328855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.329132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.329412 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.330047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.331932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.351179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] The token cache is being invalidate because project 81a8f60e7aa448afa2c4b983d552d0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:48.351762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:48.352877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-672b4dcd-c0b2-4f29-b861-8f034fc83cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:48.369656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 990/1987] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:47 2022] DELETE /identity/v3/projects/81a8f60e7aa448afa2c4b983d552d0ed => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:48.373428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f75b-4d09-4b42-a3f3-76f5dfe54e95 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.373718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f75b-4d09-4b42-a3f3-76f5dfe54e95 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.373995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3f75b-4d09-4b42-a3f3-76f5dfe54e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.395763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-52f3f75b-4d09-4b42-a3f3-76f5dfe54e95 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:48.397026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-52f3f75b-4d09-4b42-a3f3-76f5dfe54e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.405323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 991/1988] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:48.412884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.413174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.413453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.433970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:48.435236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.447843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 992/1989] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:48.448646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.464381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8719c1-067c-421f-a194-24695aafc50c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.470833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.471771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.472056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.472174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 998/1990] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:48.473649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.473873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.473954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:48.473954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.475118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.475488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.490155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 993/1991] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:48.494903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.509789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc717c1-261f-4dc9-9e97-a4bb084c783b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.557915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf14158-a80d-4353-be83-6b5c5d1aaec5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.574357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.574994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.575451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.575737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.576424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.577458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.578356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.578464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.578942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.579417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.580264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.582379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.714441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 994/1992] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:48.714441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.715172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 999/1993] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:48 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:48.715172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:48.720046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.721841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:48.739687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17427b-0468-4be7-b723-84c79c383c8a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.798747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd193b-b6e0-4a59-85d9-8c113d7f1c6d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:48.805526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.806173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.806459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.806736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] PATH_INFO: `/v3/projects/62034ffd262f40a19690e4bac3cd675f` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.808822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62034ffd262f40a19690e4bac3cd675f)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.811759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.820932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:48.822057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:48.822348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:48.822638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] PATH_INFO: `/v3/projects/85790368569045bba21dda7303443f10` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:48.824178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=85790368569045bba21dda7303443f10)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:48.826564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:48.987576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85790368569045bba21dda7303443f10', 'request_id': 'req-9130ae30-4a70-43cf-a04e-ddbae467c47a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.001575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62034ffd262f40a19690e4bac3cd675f', 'request_id': 'req-04c07161-1f1a-409f-b2f2-f9b01b2709f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.008372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62034ffd262f40a19690e4bac3cd675f', 'request_id': 'req-04c07161-1f1a-409f-b2f2-f9b01b2709f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.015105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62034ffd262f40a19690e4bac3cd675f', 'request_id': 'req-04c07161-1f1a-409f-b2f2-f9b01b2709f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.104586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85790368569045bba21dda7303443f10', 'request_id': 'req-9130ae30-4a70-43cf-a04e-ddbae467c47a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.112293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85790368569045bba21dda7303443f10', 'request_id': 'req-9130ae30-4a70-43cf-a04e-ddbae467c47a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.126416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] The token cache is being invalidate because project 85790368569045bba21dda7303443f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:49.126926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.127996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.130281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1000/1994] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:48 2022] DELETE /identity/v3/projects/85790368569045bba21dda7303443f10 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:49.131248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:49.133960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:49.204319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] The token cache is being invalidate because project 62034ffd262f40a19690e4bac3cd675f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:49.204622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.205414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.207432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 995/1995] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:48 2022] DELETE /identity/v3/projects/62034ffd262f40a19690e4bac3cd675f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:49.211300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:49.212741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:49.216356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ae30-4a70-43cf-a04e-ddbae467c47a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:49.280091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:49.280756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:49.281043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:49.281888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:49.282561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:49.283970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c07161-1f1a-409f-b2f2-f9b01b2709f7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:49.284535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:49.288654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:49.289274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:49.289555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:49.289830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:49.290946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:49.292727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:49.303179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 996/1996] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:49.304089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:49.305775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:49.318361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d49b3-ac0e-48b9-9813-25aac0d47582 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:49.323271 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:49.323918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:49.324222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:49.324506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] PATH_INFO: `/v3/users/e4117d07103d42f3a4bff0158923b043` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:49.325783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4117d07103d42f3a4bff0158923b043)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:49.327712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:49.441839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1001/1997] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:49 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:49.443038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:49.444944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:49.457797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f46bb3-5646-4a26-bb4e-b614b4821291 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:49.462627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:49.463244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:49.463530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:49.463839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] PATH_INFO: `/v3/users/cd1b7bc463c44863a2613742fa1903ca` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:49.465030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1b7bc463c44863a2613742fa1903ca)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:49.466953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:49.668570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4117d07103d42f3a4bff0158923b043'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.681466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4117d07103d42f3a4bff0158923b043'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.682303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4117d07103d42f3a4bff0158923b043'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.690114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4117d07103d42f3a4bff0158923b043'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.819934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1b7bc463c44863a2613742fa1903ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.840497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4117d07103d42f3a4bff0158923b043'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.867348 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 997/1998] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:49 2022] DELETE /identity/v3/users/e4117d07103d42f3a4bff0158923b043 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:49.869237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:49.873754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:49.958643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1b7bc463c44863a2613742fa1903ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.977829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1b7bc463c44863a2613742fa1903ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.980066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1b7bc463c44863a2613742fa1903ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:49.990893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1b7bc463c44863a2613742fa1903ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:50.004487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1002/1999] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:49 2022] DELETE /identity/v3/users/cd1b7bc463c44863a2613742fa1903ca => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:50.004721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.006068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:50.029045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb90ea-ca20-41fe-b5ea-7e715314b3e7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.046181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:50.103879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c6a96-5f12-4cc1-9d69-23bf09224663 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.112133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.112902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.113340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.113672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.114236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.116095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.123149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.124119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.125672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.126089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.126891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.129328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.136246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1003/2000] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:50.140244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.153194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 998/2001] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:50.162983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.170684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:50.175693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7833e2-0798-4636-ac1d-2501ab661fa7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.185239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.187193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.188378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.188844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.189739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.192586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.207886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b3b8e-8b97-4982-9de7-2eda1f27c5b6 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.209780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1004/2002] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:50.214207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.223683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.224650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.226394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.227095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] PATH_INFO: `/v3/projects/e13f147425cf4af0bb2885d337d56382/users/07c504cd37184cbfb7cb98e2097b4486/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.232337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bb9f2-2fc2-4ae7-a772-6a184481b0f7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.242625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.243571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.243894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.244298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] PATH_INFO: `/v3/projects/81d8412b26744cdca6e9df42c15e197f/users/207cf62e3d604d809901ea913682495f/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.274394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d8412b26744cdca6e9df42c15e197f, user_id=207cf62e3d604d809901ea913682495f, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.274847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13f147425cf4af0bb2885d337d56382, user_id=07c504cd37184cbfb7cb98e2097b4486, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.278875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18965cd0-8354-4e41-b850-179029a7373c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.279019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a0a56-3619-49a9-bf53-67648aa6c0ad admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.333788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:50.395752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1005/2003] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:50 2022] PUT /identity/v3/projects/81d8412b26744cdca6e9df42c15e197f/users/207cf62e3d604d809901ea913682495f/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:50.402569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 999/2004] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:50 2022] PUT /identity/v3/projects/e13f147425cf4af0bb2885d337d56382/users/07c504cd37184cbfb7cb98e2097b4486/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:50.407378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.407898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.408073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.408339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.408513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.408860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.443862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] MFA Rules not processed for user `207cf62e3d604d809901ea913682495f`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:50.445720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:50.465676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:50.467289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:50.619655 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1000/2005] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:50.625703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.665924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1006/2006] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:50.691374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.693006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:50.759945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9c2c-432b-48bd-a359-245764dea37c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.766281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.767057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.767493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.767870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.768676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.770866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.794067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88740f61-c523-4ff7-9b65-e2677089ef19 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.799050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.799975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.800292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.800570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.812347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.815892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:50.826754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1007/2007] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:50.894014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:50.902509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1001/2008] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:50 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:50.911239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0348c-f25d-441b-a936-179e18d8a100 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:50.983540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:50.985221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:50.985694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:50.986219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:50.987381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:50.991363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.046438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.049281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.064918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccae2b8-66bd-4d3c-a924-628de8e603b7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.072155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.072858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.073143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.073642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] PATH_INFO: `/v3/projects/b0d0bfc986fa459b93655d1aa737b47c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.074734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d0bfc986fa459b93655d1aa737b47c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.076774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.108016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1008/2009] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:50 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:51.123395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.136614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113570ec-6730-469d-b924-5dd557acb3a3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.144778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.145407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.145743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.146079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.146847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.148776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.162568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1009/2010] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:51.166575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.180825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f82d5a1-da35-4d90-aecb-f32d51d920d3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.191509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.192537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.194447 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.195032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] PATH_INFO: `/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc/users/80a4062af98c47e29f71e692d01b6a6b/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.220166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6499c2a8be048dcb5f434fa4ab8ccbc, user_id=80a4062af98c47e29f71e692d01b6a6b, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.221501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d0bfc986fa459b93655d1aa737b47c', 'request_id': 'req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.223980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.237228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d0bfc986fa459b93655d1aa737b47c', 'request_id': 'req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.252531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d0bfc986fa459b93655d1aa737b47c', 'request_id': 'req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.335232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1010/2011] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:51 2022] PUT /identity/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc/users/80a4062af98c47e29f71e692d01b6a6b/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:51.336136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.343218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.358993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] The token cache is being invalidate because project b0d0bfc986fa459b93655d1aa737b47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:51.360043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.361308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.363350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1002/2012] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:51 2022] DELETE /identity/v3/projects/b0d0bfc986fa459b93655d1aa737b47c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:51.364466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.365912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.448916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ecc73-573e-49e5-8ffc-1143a92f34d9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.455940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.456909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.457258 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.457595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] PATH_INFO: `/v3/projects/012c4f017ab34f039c5d7e6f1502af8a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.458353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae2dbf-ddf3-4db1-8baf-63c51ff2ed43 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.458990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] RBAC: Authorizing `identity:delete_project(project_id=012c4f017ab34f039c5d7e6f1502af8a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.461293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.464187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.468715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.468715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.468715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.468715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.468715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5215c-5ac9-4c81-b89f-881f5f2a161d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.480464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1003/2013] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:51.482037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.482851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.482851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.514695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:51.516448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.532098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1004/2014] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:51.532098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.543434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9401-21ea-43b0-8387-cc0fc07f527d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.560159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.560159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.560159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.560159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] PATH_INFO: `/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc/users/80a4062af98c47e29f71e692d01b6a6b/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.560639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6499c2a8be048dcb5f434fa4ab8ccbc, user_id=80a4062af98c47e29f71e692d01b6a6b, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.560639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b40dfd-b7ec-4cca-b2ea-1a504a2b16b5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.571268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1005/2015] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:51 2022] PUT /identity/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc/users/80a4062af98c47e29f71e692d01b6a6b/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:51.573297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3ca3-1911-48d1-b28a-60403ceb973b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.573928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3ca3-1911-48d1-b28a-60403ceb973b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.574503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3ca3-1911-48d1-b28a-60403ceb973b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.600346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-619b3ca3-1911-48d1-b28a-60403ceb973b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:51.601763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-619b3ca3-1911-48d1-b28a-60403ceb973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.646647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012c4f017ab34f039c5d7e6f1502af8a', 'request_id': 'req-645aab43-1e69-448d-a07a-84af3a2c4481'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.665289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:51.674673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1006/2016] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:51.676478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.676478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.676662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.707233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] MFA Rules not processed for user `80a4062af98c47e29f71e692d01b6a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:51.708529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.756264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012c4f017ab34f039c5d7e6f1502af8a', 'request_id': 'req-645aab43-1e69-448d-a07a-84af3a2c4481'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.765336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012c4f017ab34f039c5d7e6f1502af8a', 'request_id': 'req-645aab43-1e69-448d-a07a-84af3a2c4481'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.786542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] The token cache is being invalidate because project 012c4f017ab34f039c5d7e6f1502af8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:51.788494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.788494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:51.789504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1011/2017] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:51 2022] DELETE /identity/v3/projects/012c4f017ab34f039c5d7e6f1502af8a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:51.790289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.796477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.808513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1007/2018] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:51.809480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.810781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:51.926339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645aab43-1e69-448d-a07a-84af3a2c4481 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.934401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873e6fe-4dac-4721-b48c-8b540bdf8fb3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:51.935565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:51.941016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.942744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.957819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.957819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.957819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:51.957819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.959456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:51.959456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:51.959456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:51.959456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] PATH_INFO: `/v3/users/542058a9a79844b9b47b2148f006cab0` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:51.959973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.960328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=542058a9a79844b9b47b2148f006cab0)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:51.960328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:51.971729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1012/2019] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:51.972862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:51.975441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:52.048669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6160c41-6178-4ea8-bb7f-6b3e5e0c3131 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.052571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.053299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.053756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.054104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.058257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:52.072667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:52.074451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:52.087756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1013/2020] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:52.088981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:52.101837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536dc55-e2f8-4389-8fea-18a0ae6e36d6 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.109951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.110527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.110818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.111851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.112496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:52.115852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:52.511688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1014/2021] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:52 2022] POST /identity/v3/projects => generated 369 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:52.512861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:52.588425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542058a9a79844b9b47b2148f006cab0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:52.593315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19734f-54f6-4634-9a34-23d4f7673923 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.600243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.600868 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.601149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.601512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.603113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:52.605012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:52.618371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542058a9a79844b9b47b2148f006cab0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:52.627638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542058a9a79844b9b47b2148f006cab0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:52.631328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542058a9a79844b9b47b2148f006cab0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:52.741510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1015/2022] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:52 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:52.742687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:52.744572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:52.764156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542058a9a79844b9b47b2148f006cab0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:52.776978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1008/2023] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:51 2022] DELETE /identity/v3/users/542058a9a79844b9b47b2148f006cab0 => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:52.776978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:52.776978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:52.849215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e414d-b84c-461a-958d-71a48fa191ce admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.916171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300cd7-5041-42c4-bbaa-f0147a7023ed admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.929051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.930562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.931808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.931808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.932960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:52.934634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:52.949005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1009/2024] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:52.953852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:52.966373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.966990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.967280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.967549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d88d7-17ab-44e2-add5-9f121bead8a5 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:52.967665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.974605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:52.975347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:52.975642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:52.976033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:52.976903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:52.977409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:52.979595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:52.997981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1010/2025] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:53.002869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:53.026332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf567-27b0-4476-9055-88cb0d4cd8bd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:53.033400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:53.035392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.035957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.036469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] PATH_INFO: `/v3/projects/6b2ec69f3a564cc5ae2bdd0f7bb36a77/users/2ac8d8cea9324c3bb01095f68d220ef7/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.059045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2ec69f3a564cc5ae2bdd0f7bb36a77, user_id=2ac8d8cea9324c3bb01095f68d220ef7, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.062250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:53.089565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.091113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451e13e-4b12-40c7-8ebf-e00847e6aee5 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:53.105242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1016/2026] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:53.169687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1011/2027] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:53 2022] PUT /identity/v3/projects/6b2ec69f3a564cc5ae2bdd0f7bb36a77/users/2ac8d8cea9324c3bb01095f68d220ef7/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:53.181754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715564-ba2e-46ba-b311-6cd634b50eb6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.182050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715564-ba2e-46ba-b311-6cd634b50eb6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.182317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715564-ba2e-46ba-b311-6cd634b50eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.275586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-fc715564-ba2e-46ba-b311-6cd634b50eb6 None None] MFA Rules not processed for user `2ac8d8cea9324c3bb01095f68d220ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:53.277512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fc715564-ba2e-46ba-b311-6cd634b50eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:53.411132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1017/2028] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:53.415014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:53.457332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.457769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.458162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.516384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] MFA Rules not processed for user `07c504cd37184cbfb7cb98e2097b4486`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:53.520961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:53.539198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d456a5-fc4f-4d50-982d-f2378f906d2d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:53.545484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:53.546113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.546401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.546678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.547364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.549748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:53.621253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1018/2029] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:53.640956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:53.649829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:53.687859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1012/2030] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:53 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:53.690381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:53.692870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:53.766980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f7f33-d85a-4537-8e2c-c34698f847f6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:53.813641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3386e508-a25e-432c-b5e9-9927a99c4d21 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:53.828940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:53.831494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.832240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.834532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] PATH_INFO: `/v3/projects/0b04a729f5ab438f8ce4a62ec5056201` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.836173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b04a729f5ab438f8ce4a62ec5056201)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.844851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:53.868473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:53.869419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.869713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.870297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.947431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.949051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:53.963946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1019/2031] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:53.966813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:53.983208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff378b4-fff1-4031-89d6-70c945f36e0f service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:53.991313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:53.991941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:53.992238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:53.992517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:53.993153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:53.995112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.002687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b04a729f5ab438f8ce4a62ec5056201', 'request_id': 'req-01d5cd4b-b771-4338-aac1-353d126a3aba'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:54.010136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b04a729f5ab438f8ce4a62ec5056201', 'request_id': 'req-01d5cd4b-b771-4338-aac1-353d126a3aba'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:54.017781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b04a729f5ab438f8ce4a62ec5056201', 'request_id': 'req-01d5cd4b-b771-4338-aac1-353d126a3aba'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:54.133204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1020/2032] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:53 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:54.136042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.147588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f9f9-a09f-4881-a5d6-5c648d3936eb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.160284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] The token cache is being invalidate because project 0b04a729f5ab438f8ce4a62ec5056201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:04:54.163230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:54.163230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-01d5cd4b-b771-4338-aac1-353d126a3aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:54.163230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1013/2033] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:04:53 2022] DELETE /identity/v3/projects/0b04a729f5ab438f8ce4a62ec5056201 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:54.168863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add04-06a2-4111-b26b-dafd525b6de9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.169548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add04-06a2-4111-b26b-dafd525b6de9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.169686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9add04-06a2-4111-b26b-dafd525b6de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.191410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5d9add04-06a2-4111-b26b-dafd525b6de9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:54.192689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5d9add04-06a2-4111-b26b-dafd525b6de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.215011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.216484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.218147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.218839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.220213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.222071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.248240 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1021/2034] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:54.251401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.253523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.267155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844442-c1d7-426e-90a7-4f4ad383b298 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.269169 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1014/2035] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:54.272583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.273309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.273661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.274019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] PATH_INFO: `/v3/projects/07bb234f58984df9a1fd0441d9fefa0b/users/cc13b8dafe554235b9972b0067a2feea/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.281812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.282282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.282860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.293193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bb234f58984df9a1fd0441d9fefa0b, user_id=cc13b8dafe554235b9972b0067a2feea, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.296300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.310416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:54.311741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.320664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1015/2036] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:54.325083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.335460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65378-41d5-4505-8f2b-6b7f70e1674b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.341540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.345780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.357596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1016/2037] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:04:54.361789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.376542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fdc07-410f-4e5d-b20a-bb592798c5f1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.378010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1022/2038] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:54 2022] PUT /identity/v3/projects/07bb234f58984df9a1fd0441d9fefa0b/users/cc13b8dafe554235b9972b0067a2feea/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:54.378981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.442995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.446600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.446600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.446600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.446600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.446915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.450335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0c75-009e-4883-9829-1c3273ee54b9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.456975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.457543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.457831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.458259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.458916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.460538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.471735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1023/2039] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:54.480650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.492562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd585731-b9c6-42bf-b90a-95fd9a6f0c1e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.498399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.499073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.499359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.499637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] PATH_INFO: `/v3/projects/07bb234f58984df9a1fd0441d9fefa0b/users/cc13b8dafe554235b9972b0067a2feea/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.502217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bb234f58984df9a1fd0441d9fefa0b, user_id=cc13b8dafe554235b9972b0067a2feea, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.506809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de7113-68c0-4867-8f59-05838a56d714 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.515703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1024/2040] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:54 2022] PUT /identity/v3/projects/07bb234f58984df9a1fd0441d9fefa0b/users/cc13b8dafe554235b9972b0067a2feea/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:54.526231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.530877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.530877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.561278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] MFA Rules not processed for user `cc13b8dafe554235b9972b0067a2feea`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:54.562524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.574537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1017/2041] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:54 2022] POST /identity/v3/projects => generated 381 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:54.575492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.648603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1025/2042] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:54.650772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f57cec-a067-40bb-b949-8031f85bf296 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.663008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.663668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.663958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.664125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.664255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.664905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.667051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.667232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.738280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab94a2-c9cc-4fef-b4be-d5caab89d7f6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.792281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.792892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.793192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.793466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.805055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1018/2043] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:54 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:54.811052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.826164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c425d4-59c0-454f-ad67-be90ba719780 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.834017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.835069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.835571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.836047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.845400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.845400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.857852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1019/2044] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:54.864160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.878034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.878034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.878205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120ee0f-7acf-4fc0-9570-7bb6c79117a0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.884283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.884922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.885341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.885909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.886811 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.888739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1026/2045] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:54.901153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615b8f-b53e-47dd-bfc0-e145c2bf1065 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.932742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:54.938534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1020/2046] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:54.942841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.953879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc33794-15de-4ea8-9f7d-65fde78030a6 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.959542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.960417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.960767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.961079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] PATH_INFO: `/v3/projects/b6f60659e9b74176aa05d99675a2ea5e/users/fc1e6146ea244ff59fea3ce3485331ac/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.979262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f60659e9b74176aa05d99675a2ea5e, user_id=fc1e6146ea244ff59fea3ce3485331ac, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.982049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.101155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1027/2047] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:54 2022] PUT /identity/v3/projects/b6f60659e9b74176aa05d99675a2ea5e/users/fc1e6146ea244ff59fea3ce3485331ac/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:55.112104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.112708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.112708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.150226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] MFA Rules not processed for user `fc1e6146ea244ff59fea3ce3485331ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:55.151789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:55.238711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1021/2048] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:55.244452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:55.253776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:55.319012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c369a9-32dd-4265-8351-5ffb84d447a5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:55.323809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:55.324450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.324734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.325009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.325689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:55.327624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.427531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1028/2049] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:55 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:04:55.431694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:55.442458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23371d-c35f-45b1-9e6c-474d2b4d752d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:55.503775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:55.504431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.504723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.505072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.505629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:55.507573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.621878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1022/2050] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:55 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:55.626732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:55.637144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19bcf3-e87e-4494-a9e6-c671392d9441 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:55.642353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:55.642971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.643249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.643555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.644235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:55.645831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.660016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1029/2051] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:55.664890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:55.676412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf21c06-4d1e-4fdf-b2a7-7c3f74eca5e1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:55.681446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:55.682191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.682470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.682745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.683506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:55.685074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a8b28-becb-4acf-9cca-bc075a900a06 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.696244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1023/2052] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:55.700278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:55.711044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ea562-506b-4f39-8443-f900bc88bfcc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:55.715989 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:55.716715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.717021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.717296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] PATH_INFO: `/v3/projects/eeb37b1bea174aaf8c02ff17f8177689/users/90741e5c10f64c2d80c6247697007f1f/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.732582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb37b1bea174aaf8c02ff17f8177689, user_id=90741e5c10f64c2d80c6247697007f1f, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:55.735255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:55.910732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1030/2053] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:55 2022] PUT /identity/v3/projects/eeb37b1bea174aaf8c02ff17f8177689/users/90741e5c10f64c2d80c6247697007f1f/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:55.921581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:55.921921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:55.922195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:55.955979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] MFA Rules not processed for user `90741e5c10f64c2d80c6247697007f1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:55.957376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:56.034616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1024/2054] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:56.039244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.120557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5188a-36bc-4b9f-8414-ed9d059d7a43 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.127425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.128242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.128590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.128994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.129734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.131994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.268332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1031/2055] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:04:56 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:56.274686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.286217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a545c-e950-4166-b1e6-da6cb46363fa None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.357793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.358588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.358928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.359141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.362872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.365485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.435024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1025/2056] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:04:56 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:04:56.440347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.458430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44179502-3d17-409b-b2e9-53ac2f8cf92b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.466804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.467661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.468083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.468448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.469832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.471708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.486804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1032/2057] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:04:56.489174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.500190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deb5f2-a5e0-4d25-b9a8-e118b79e65fa admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.505085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.506243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.506243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.506433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] PATH_INFO: `/v3/projects/e735c8b690184e7389157da61f37123f/users/1c0af62709134b0e8bf8ba3c10597b66/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.533343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e735c8b690184e7389157da61f37123f, user_id=1c0af62709134b0e8bf8ba3c10597b66, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.536133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.659056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1026/2058] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:56 2022] PUT /identity/v3/projects/e735c8b690184e7389157da61f37123f/users/1c0af62709134b0e8bf8ba3c10597b66/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:04:56.669866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.677966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d975f-2ca3-40ec-9aa2-47b7e73f63ed admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.756559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.760428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.760428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.760428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.760428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.760428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dcf2b-54be-4b91-9882-39c66b86a141 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.773277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1033/2059] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:04:56.777689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.789284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6b28-474c-40c9-96ac-2e81a9e7a512 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:56.794777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:56.795547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.800587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.800587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] PATH_INFO: `/v3/projects/e735c8b690184e7389157da61f37123f/users/1c0af62709134b0e8bf8ba3c10597b66/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.800587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e735c8b690184e7389157da61f37123f, user_id=1c0af62709134b0e8bf8ba3c10597b66, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:56.802232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440beb3-3a52-4f82-a8ac-d9a8c8c58289 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:56.814766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1027/2060] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:04:56 2022] PUT /identity/v3/projects/e735c8b690184e7389157da61f37123f/users/1c0af62709134b0e8bf8ba3c10597b66/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:56.825952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.826468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.826886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.898103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] MFA Rules not processed for user `1c0af62709134b0e8bf8ba3c10597b66`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:56.898103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:56.926397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:56.927249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:56.927679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:56.952424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] MFA Rules not processed for user `07c504cd37184cbfb7cb98e2097b4486`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:56.954680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:56.966867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1034/2061] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:56.979749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:56.981216 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:57.016471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1028/2062] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:57.047430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56166d03-9ec7-4c80-ab13-768dbb7c0cd4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:57.053807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:57.054884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:57.055400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:57.055913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:57.169396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:57.173055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd8189-40fd-4707-bc11-50793b97a87e service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:57.186739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1035/2063] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:57.200796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:57.457932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:59.260302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:59.368028 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63c392-aaf0-4b8e-a2f1-57b961d70fc6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:59.374790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:59.375722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:59.376081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:59.376470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] PATH_INFO: `/v3/users/2ac8d8cea9324c3bb01095f68d220ef7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:59.377706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac8d8cea9324c3bb01095f68d220ef7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:59.379694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:59.513365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:59.619706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac8d8cea9324c3bb01095f68d220ef7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:59.633954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac8d8cea9324c3bb01095f68d220ef7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:59.635832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac8d8cea9324c3bb01095f68d220ef7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:59.643276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac8d8cea9324c3bb01095f68d220ef7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:59.768611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac8d8cea9324c3bb01095f68d220ef7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:04:59.782407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1029/2064] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:04:59 2022] DELETE /identity/v3/users/2ac8d8cea9324c3bb01095f68d220ef7 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:04:59.788994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:59.789502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:59.790085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:59.813667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:59.817307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:59.877643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1036/2065] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:04:59.898923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:59.900478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:59.971506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b56da-d75f-48be-9143-a379e22467e8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:59.975754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:59.976619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:59.980558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:59.980558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:59.989499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:59.991172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:00.007308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1030/2066] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:00.553047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:00.554595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:00.570917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b016180-b325-4690-a96a-7dc01c2fea6a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:00.580411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:00.580411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:00.580411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:00.580411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] PATH_INFO: `/v3/projects/6b2ec69f3a564cc5ae2bdd0f7bb36a77` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:00.581085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2ec69f3a564cc5ae2bdd0f7bb36a77)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:00.581635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:00.726451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:00.727926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:00.752717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2ec69f3a564cc5ae2bdd0f7bb36a77', 'request_id': 'req-ab967f6b-0e6d-435e-acfd-f71a766abfbe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:00.792561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96080b09-f2d5-4748-bedd-255f0b7fca5a service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:00.847421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2ec69f3a564cc5ae2bdd0f7bb36a77', 'request_id': 'req-ab967f6b-0e6d-435e-acfd-f71a766abfbe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:00.855926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2ec69f3a564cc5ae2bdd0f7bb36a77', 'request_id': 'req-ab967f6b-0e6d-435e-acfd-f71a766abfbe'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:00.857267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:00.857986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:00.858402 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:00.858792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:00.861487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:00.868847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] The token cache is being invalidate because project 6b2ec69f3a564cc5ae2bdd0f7bb36a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:00.869135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:00.870057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:00.871646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1037/2067] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:00 2022] DELETE /identity/v3/projects/6b2ec69f3a564cc5ae2bdd0f7bb36a77 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:00.876509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:00.878128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:00.930744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:00.932163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:00.943568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1031/2068] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:00.958924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab967f6b-0e6d-435e-acfd-f71a766abfbe admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:00.965048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:00.965327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:00.965615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:00.965905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] PATH_INFO: `/v3/users/cc13b8dafe554235b9972b0067a2feea` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:00.967085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc13b8dafe554235b9972b0067a2feea)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:00.970003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:01.042672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:01.237300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc13b8dafe554235b9972b0067a2feea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:01.392660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc13b8dafe554235b9972b0067a2feea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:01.408660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc13b8dafe554235b9972b0067a2feea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:01.410843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc13b8dafe554235b9972b0067a2feea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:01.423879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc13b8dafe554235b9972b0067a2feea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:01.432432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1038/2069] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:00 2022] DELETE /identity/v3/users/cc13b8dafe554235b9972b0067a2feea => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:01.875991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:01.956279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:01.973820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a0ae-1b2b-48da-afbb-a9183f5ef8cc service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:02.019742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:02.021565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.051274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:02.052005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.052398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.052745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] PATH_INFO: `/v3/projects/07bb234f58984df9a1fd0441d9fefa0b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.053958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bb234f58984df9a1fd0441d9fefa0b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:02.056055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:02.098380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9794a4-9d90-4b63-858e-f3516d8c0528 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:02.106852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:02.107568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.108000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.108320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] PATH_INFO: `/v3/users/207cf62e3d604d809901ea913682495f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.109529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=207cf62e3d604d809901ea913682495f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:02.111669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:02.212140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bb234f58984df9a1fd0441d9fefa0b', 'request_id': 'req-208a8839-3e78-406d-9d9b-e1a45d0089c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.219981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bb234f58984df9a1fd0441d9fefa0b', 'request_id': 'req-208a8839-3e78-406d-9d9b-e1a45d0089c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.226228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bb234f58984df9a1fd0441d9fefa0b', 'request_id': 'req-208a8839-3e78-406d-9d9b-e1a45d0089c6'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.361617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] The token cache is being invalidate because project 07bb234f58984df9a1fd0441d9fefa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:02.362216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.363130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-208a8839-3e78-406d-9d9b-e1a45d0089c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.367747 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1032/2070] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:01 2022] DELETE /identity/v3/projects/07bb234f58984df9a1fd0441d9fefa0b => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:02.371586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde4bb-8981-479d-acb6-3382e4fddf52 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.372155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde4bb-8981-479d-acb6-3382e4fddf52 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.372580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde4bb-8981-479d-acb6-3382e4fddf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.401242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207cf62e3d604d809901ea913682495f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.402498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-cfbde4bb-8981-479d-acb6-3382e4fddf52 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:02.403834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cfbde4bb-8981-479d-acb6-3382e4fddf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.500928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1033/2071] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:02.511428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.511778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.512031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.535752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:02.537174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.545358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1034/2072] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:02.549126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207cf62e3d604d809901ea913682495f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.553413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:02.575770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db224bf3-cfe3-4953-ab72-60b2dcfa5d63 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:02.579871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207cf62e3d604d809901ea913682495f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.580805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207cf62e3d604d809901ea913682495f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.585215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:02.585973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.586251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.586549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.587564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:02.587564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:02.589163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:02.590197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30777312-6852-4566-8fea-c631bc282cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207cf62e3d604d809901ea913682495f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:02.597408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1039/2073] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:02 2022] DELETE /identity/v3/users/207cf62e3d604d809901ea913682495f => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:02.602846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.602846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.603906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.606386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1035/2074] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:02.610649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:02.612436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.627417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e5739-9157-4456-b2b1-289e35af851c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:02.630949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:02.633595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.703962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:02.704843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.705288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.705629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.706375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:02.708500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:02.740919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1040/2075] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:02.751755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:02.753115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:02.830220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c433d5b-06f1-4246-ba67-46ba4f192ce1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:02.834136 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:02.834810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:02.835015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:02.835311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:02.845195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:02.846625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:02.856703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1041/2076] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:02.924192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1036/2077] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:02 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:02.925431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:02.945140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ad67-8610-4c9d-ad4f-22bb07cc0f74 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.065340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.067104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.067602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.068082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.069004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.071739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.130800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.132814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.221587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f63c42-651f-4643-b409-602f486d93d8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.226758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1042/2078] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:02 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:03.227855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.230697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.231601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.232101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.232631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.235589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.240380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f999e2-b57a-4426-ab65-42b3f56ca640 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.247722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.248733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.249080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.249370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.250272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.252735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.268440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1043/2079] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:03.270727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.282056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e3ea-637f-43c3-8d6b-611b462a4ff5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.287281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.288317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.288755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.289211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.290015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.292169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.308853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1044/2080] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:03.312940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.325744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2ca8a-4854-4778-89a0-b3034d31d540 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.333993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.337735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.338025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.338305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] PATH_INFO: `/v3/projects/5721bae3fdf74dec91d53a7dd780b263/users/ce2a01df144a4c69a65798476f01235c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.353457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.355045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.356025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5721bae3fdf74dec91d53a7dd780b263, user_id=ce2a01df144a4c69a65798476f01235c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.358797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568cc5f-3f68-4ead-8468-90c9bb2535ee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.366559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1037/2081] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:03.430073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.431606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.445591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a05b-2575-43d0-9b31-4955fc671e9f service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.450586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.451497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.452571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.455618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] PATH_INFO: `/v3/projects/81d8412b26744cdca6e9df42c15e197f` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.456853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d8412b26744cdca6e9df42c15e197f)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.459168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.461370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1045/2082] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:03 2022] PUT /identity/v3/projects/5721bae3fdf74dec91d53a7dd780b263/users/ce2a01df144a4c69a65798476f01235c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:03.473859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.474628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.475062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.510933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] MFA Rules not processed for user `ce2a01df144a4c69a65798476f01235c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:03.512302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.592480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1046/2083] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:03.605261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.606699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.696587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d8412b26744cdca6e9df42c15e197f', 'request_id': 'req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:03.696742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83928c40-ebd4-4ab5-a669-d7d330ed4072 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:03.708604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d8412b26744cdca6e9df42c15e197f', 'request_id': 'req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:03.727078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d8412b26744cdca6e9df42c15e197f', 'request_id': 'req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:03.771208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:03.771955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:03.772334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:03.772678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:03.858953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] The token cache is being invalidate because project 81d8412b26744cdca6e9df42c15e197f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:03.859302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:03.860240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:03.861401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:03.863501 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:03.863785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1038/2084] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:03 2022] DELETE /identity/v3/projects/81d8412b26744cdca6e9df42c15e197f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:03.865090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:03.868844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:03.870546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:03.878283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1047/2085] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:04.072363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0c6b8-1f24-48df-b1ae-3912e9b9984e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:04.076938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:04.084246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:04.085649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:04.086388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:04.087082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] PATH_INFO: `/v3/users/80a4062af98c47e29f71e692d01b6a6b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:04.089432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a4062af98c47e29f71e692d01b6a6b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:04.093567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:04.360406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a4062af98c47e29f71e692d01b6a6b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:04.377431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a4062af98c47e29f71e692d01b6a6b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:04.378217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a4062af98c47e29f71e692d01b6a6b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:04.385656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a4062af98c47e29f71e692d01b6a6b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:04.460680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-68d1dad8-1e46-4bd3-9fba-59b4e6e1ec7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a4062af98c47e29f71e692d01b6a6b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:04.474617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1039/2086] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:03 2022] DELETE /identity/v3/users/80a4062af98c47e29f71e692d01b6a6b => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:05.111365 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:05.397107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:05.410734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c053d1-d717-4fea-845d-34c86b0350f9 service glance] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:05.497771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:05.498819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:05.499739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:05.500486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] PATH_INFO: `/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:05.502030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6499c2a8be048dcb5f434fa4ab8ccbc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:05.504299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:05.743726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6499c2a8be048dcb5f434fa4ab8ccbc', 'request_id': 'req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:05.845232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6499c2a8be048dcb5f434fa4ab8ccbc', 'request_id': 'req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:05.863243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6499c2a8be048dcb5f434fa4ab8ccbc', 'request_id': 'req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:05.889320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] The token cache is being invalidate because project d6499c2a8be048dcb5f434fa4ab8ccbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:05.889748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:05.890484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3fcf4ff6-eb7f-4d76-a463-e577e3c18776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:05.897359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1048/2087] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:05 2022] DELETE /identity/v3/projects/d6499c2a8be048dcb5f434fa4ab8ccbc => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:05.899634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:05.901298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:05.901996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:05.950103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:05.951419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:06.050574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1040/2088] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:06.062452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.062927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.063357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.099524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:06.103178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:06.124320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1049/2089] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:06.132147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.159775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc3670-8b0a-4f88-b8f7-94124143b623 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.170757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.172400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.172969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.173452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.174826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:06.181278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.182218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.208553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1041/2090] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:06.216570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.238711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374bbd7-468d-4d11-9aa4-2d39adc3114e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.249537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.250849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.251409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.251995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.252840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.256980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.332088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:06.407400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1050/2091] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:06 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:06.408647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.419801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425a2ec-685e-46a4-9339-e1d679c1b8d3 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.508391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.510192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.510703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.511923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.512841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.515107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.609299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:06.637664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1042/2092] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:06 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:06.649132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.670716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a24aa-5410-4d48-ac4e-e5f294fdd082 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.686015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.686668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.686951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.687227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.687983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.690126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.716511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1051/2093] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:06.717746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.729505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff183b21-a841-4c35-84ee-87bb5d7892b9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.744779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.745539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.745959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.746723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.747493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.749507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d1a9f-f0f4-4ab5-aa0a-e9101c482b22 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.764341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1043/2094] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:06.770317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:06.781403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9327656b-4e65-41e5-a315-d5a98d6e0b3c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:06.801742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:06.802908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.802908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.803185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] PATH_INFO: `/v3/projects/a83a1837d37b4e3d85991bf997f53d71/users/53fa92803f354286865a01461ac0b74e/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:06.824672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83a1837d37b4e3d85991bf997f53d71, user_id=53fa92803f354286865a01461ac0b74e, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:06.827386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:06.929514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1052/2095] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:06 2022] PUT /identity/v3/projects/a83a1837d37b4e3d85991bf997f53d71/users/53fa92803f354286865a01461ac0b74e/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:06.941842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:06.942574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:06.942574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:07.004058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] MFA Rules not processed for user `53fa92803f354286865a01461ac0b74e`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:07.005586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:07.086371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1044/2096] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:07.091223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:07.217524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291f1da-986b-41d6-a8d9-62fbe4b014ce admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:07.227367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:07.228423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:07.228946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:07.229423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:07.230636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:07.235371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:07.357623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:07.404794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1053/2097] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:07 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:07.407043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:07.420246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc1164-2d2e-4453-9f3e-646af1e3862e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:07.502092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:07.503101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:07.503450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:07.503726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:07.504547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:07.506957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:07.637056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1045/2098] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:07 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:07.643018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:07.662270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24778bda-d4da-43ed-ab04-a835c7d5d3f5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:07.669492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:07.670339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:07.670691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:07.671036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:07.671805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:07.674164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:07.696434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1054/2099] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:07.699386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:07.724117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce32-ee2e-465b-bc1d-722f28b7ad17 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:07.729975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:07.730189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:07.730437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:07.730720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] PATH_INFO: `/v3/projects/295ce4f3fe404c72bfd98064227a98a6/users/95cf805da3d7449798014220032e5c26/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:07.753603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:07.767526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=295ce4f3fe404c72bfd98064227a98a6, user_id=95cf805da3d7449798014220032e5c26, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:07.770695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:07.882253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1046/2100] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:07 2022] PUT /identity/v3/projects/295ce4f3fe404c72bfd98064227a98a6/users/95cf805da3d7449798014220032e5c26/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:07.886173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:07.901838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87bb191-2e1f-414b-adb7-cb0023a43309 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:08.020276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:08.021421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:08.021747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:08.022161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:08.022936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:08.024807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0635ee1-400d-4197-92f2-838324db4a27 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:08.037576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1055/2101] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:08.042203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:08.053100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d76a766-a114-4884-8633-1e536db9dd8a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:08.058070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:08.058755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:08.059037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:08.059312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] PATH_INFO: `/v3/projects/295ce4f3fe404c72bfd98064227a98a6/users/95cf805da3d7449798014220032e5c26/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:08.061397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295ce4f3fe404c72bfd98064227a98a6, user_id=95cf805da3d7449798014220032e5c26, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:08.064171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:08.076427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1047/2102] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:08 2022] PUT /identity/v3/projects/295ce4f3fe404c72bfd98064227a98a6/users/95cf805da3d7449798014220032e5c26/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:08.088534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:08.088887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:08.089167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:08.121838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] MFA Rules not processed for user `95cf805da3d7449798014220032e5c26`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:08.123111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:08.233826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1056/2103] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:08.242008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:08.243702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:08.321982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf0cc0-34b9-4b4a-808e-79f32a981d14 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:08.326066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:08.326686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:08.327109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:08.327394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:08.423496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:08.426453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:08.444546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1048/2104] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:09.764190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:09.767423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:09.846115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885620f8-a516-4fd0-83d6-0d8458d8a1fe None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:09.852311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:09.852956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:09.853231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:09.853587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] PATH_INFO: `/v3/users/3fa1b5ef483e4aa295b29e546a8e18ea` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:09.854935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa1b5ef483e4aa295b29e546a8e18ea)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:09.857261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:10.134837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa1b5ef483e4aa295b29e546a8e18ea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.230559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa1b5ef483e4aa295b29e546a8e18ea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.233497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:10.236780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:10.253766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa1b5ef483e4aa295b29e546a8e18ea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.254394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2047c-fd93-44d3-ab17-97de9c95515b service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:10.256312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa1b5ef483e4aa295b29e546a8e18ea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.260771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:10.261450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:10.261697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:10.262002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] PATH_INFO: `/v3/users/fc1e6146ea244ff59fea3ce3485331ac` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:10.263394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1e6146ea244ff59fea3ce3485331ac)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:10.265447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:10.275277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8a842234-73f9-41a9-97ac-d9deeebf592a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa1b5ef483e4aa295b29e546a8e18ea'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.288512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1057/2105] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:09 2022] DELETE /identity/v3/users/3fa1b5ef483e4aa295b29e546a8e18ea => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:10.334907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:10.532425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1e6146ea244ff59fea3ce3485331ac'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.550160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1e6146ea244ff59fea3ce3485331ac'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.551080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1e6146ea244ff59fea3ce3485331ac'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.565802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1e6146ea244ff59fea3ce3485331ac'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.670865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1e6146ea244ff59fea3ce3485331ac'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:10.678414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1049/2106] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:10 2022] DELETE /identity/v3/users/fc1e6146ea244ff59fea3ce3485331ac => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:10.683010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:10.683300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:10.683580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:10.705269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:10.710772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:10.772423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1058/2107] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:10.783753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:10.785894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:10.795620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:10.797120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:10.810449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a407399-5d70-48fc-a900-fed7ffc72819 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:10.816429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:10.817154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:10.817509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:10.817858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] PATH_INFO: `/v3/projects/fc96d61e2b6c4af4920b0c7473843ed2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:10.819364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc96d61e2b6c4af4920b0c7473843ed2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:10.821470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:10.863241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df8b7-dd8f-4e33-8dae-b336441a7a53 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:10.866918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:10.867542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:10.867992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:10.868109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:10.878835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:10.880466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6c3b2-b4a1-4af8-9f25-edb3cab2981c service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:10.891736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1050/2108] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:10.902511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:10.964994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc96d61e2b6c4af4920b0c7473843ed2', 'request_id': 'req-8558ea04-2089-4ea5-a20e-0204eb250a46'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.045331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc96d61e2b6c4af4920b0c7473843ed2', 'request_id': 'req-8558ea04-2089-4ea5-a20e-0204eb250a46'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.057314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc96d61e2b6c4af4920b0c7473843ed2', 'request_id': 'req-8558ea04-2089-4ea5-a20e-0204eb250a46'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.074128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] The token cache is being invalidate because project fc96d61e2b6c4af4920b0c7473843ed2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:11.075114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.076062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8558ea04-2089-4ea5-a20e-0204eb250a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.082001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1059/2109] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:10 2022] DELETE /identity/v3/projects/fc96d61e2b6c4af4920b0c7473843ed2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:11.087022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.087411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.087785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.112970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:11.114373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:11.182938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1051/2110] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:11.192165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.192606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.192938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.218611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:11.220331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:11.229733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1060/2111] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:11.234409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.249261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a78171-3e2d-41f7-ab97-9d26f186134f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.261493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:11.262131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.262419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.262789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.263352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:11.263649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:11.265472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:11.279576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1052/2112] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:11.285771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.295433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4bed-9573-4e46-b312-a7b7f0d5c29f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.302011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:11.307724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.307724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.307724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.307724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:11.307724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:11.445308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.445777 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1061/2113] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:11 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:11.449306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.450531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:11.470933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d900f-a557-4509-8d2e-0402daa53284 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.543867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:11.544650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.544954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d7fc5-ad41-481b-80dc-5a2187af71b0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.545070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.545409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] PATH_INFO: `/v3/projects/b6f60659e9b74176aa05d99675a2ea5e` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.548970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f60659e9b74176aa05d99675a2ea5e)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:11.551116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:11.551452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:11.551833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.552122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.552442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.553272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:11.555262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:11.805424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f60659e9b74176aa05d99675a2ea5e', 'request_id': 'req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.807548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f60659e9b74176aa05d99675a2ea5e', 'request_id': 'req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.815226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f60659e9b74176aa05d99675a2ea5e', 'request_id': 'req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.852769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1062/2114] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:11 2022] POST /identity/v3/users => generated 292 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:11.859094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.876308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80427ef5-15f9-49ff-8b31-e3b2c8b5953e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.958050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:11.958050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:11.958050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:11.958050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:11.958510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:11.958596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] The token cache is being invalidate because project b6f60659e9b74176aa05d99675a2ea5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:11.959092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.959248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:11.960834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:11.964171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1053/2115] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:11 2022] DELETE /identity/v3/projects/b6f60659e9b74176aa05d99675a2ea5e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:11.969818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.972095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:11.975147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1063/2116] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:11.979567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:11.981739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:11.995155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6000df-df55-4eb5-a24e-aaeb40ba25d7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:11.997323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141896b-08a9-462d-b3a6-3bfb1bf8e26a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:12.003311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:12.004093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:12.004314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:12.004678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:12.005020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:12.005314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:12.005812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:12.005975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:12.006292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] PATH_INFO: `/v3/users/90741e5c10f64c2d80c6247697007f1f` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:12.008057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:12.008783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90741e5c10f64c2d80c6247697007f1f)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:12.015654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:12.024296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1064/2117] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:12.028660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:12.049103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f2308-253d-4ccd-9605-5d0731e5e072 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:12.062357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:12.063131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:12.063419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:12.063704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] PATH_INFO: `/v3/projects/62d74fd26ee44391b4c3013f240c3327/users/f0aaac875caf4997bcfe3e05c222a9c5/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:12.087754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d74fd26ee44391b4c3013f240c3327, user_id=f0aaac875caf4997bcfe3e05c222a9c5, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:12.091738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d1959-6b01-42dc-b357-5808989b20ea admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:12.220397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1065/2118] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:12 2022] PUT /identity/v3/projects/62d74fd26ee44391b4c3013f240c3327/users/f0aaac875caf4997bcfe3e05c222a9c5/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:12.232111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:12.232563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:12.233001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:12.279172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] MFA Rules not processed for user `f0aaac875caf4997bcfe3e05c222a9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:12.281369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:12.355994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90741e5c10f64c2d80c6247697007f1f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:12.371420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90741e5c10f64c2d80c6247697007f1f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:12.372657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90741e5c10f64c2d80c6247697007f1f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:12.382139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1066/2119] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:12.383123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90741e5c10f64c2d80c6247697007f1f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:12.396305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:12.397880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:12.448187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:12.499886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53788-3415-4afd-85b3-9acb248e5bab None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:12.506237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:12.506869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:12.507155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:12.507428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:12.509329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:12.513274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90741e5c10f64c2d80c6247697007f1f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:12.521422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:12.523205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:12.525606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1054/2120] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:11 2022] DELETE /identity/v3/users/90741e5c10f64c2d80c6247697007f1f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:12.534482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1067/2121] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:12.836349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:13.180068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:13.182103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:13.298178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a18fe-a5bf-4d7e-92d8-564b7098cce4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:13.303370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:13.304049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:13.304377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:13.304661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] PATH_INFO: `/v3/projects/eeb37b1bea174aaf8c02ff17f8177689` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:13.305894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb37b1bea174aaf8c02ff17f8177689)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:13.307921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:13.472748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb37b1bea174aaf8c02ff17f8177689', 'request_id': 'req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:13.480293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb37b1bea174aaf8c02ff17f8177689', 'request_id': 'req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:13.511748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb37b1bea174aaf8c02ff17f8177689', 'request_id': 'req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:13.611712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] The token cache is being invalidate because project eeb37b1bea174aaf8c02ff17f8177689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:13.612060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:13.612826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:13.614855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1055/2122] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:13 2022] DELETE /identity/v3/projects/eeb37b1bea174aaf8c02ff17f8177689 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:13.619221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:13.704408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c5639-c97b-4f93-ad59-1273c9166488 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:13.767153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:13.767824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:13.768111 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:13.768418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] PATH_INFO: `/v3/users/1c0af62709134b0e8bf8ba3c10597b66` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:13.769792 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c0af62709134b0e8bf8ba3c10597b66)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:13.771711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:14.010890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c0af62709134b0e8bf8ba3c10597b66'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:14.096317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c0af62709134b0e8bf8ba3c10597b66'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:14.119845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c0af62709134b0e8bf8ba3c10597b66'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:14.121811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c0af62709134b0e8bf8ba3c10597b66'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:14.148854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-bb40d973-84f9-469f-9847-ba807382cc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c0af62709134b0e8bf8ba3c10597b66'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:14.148854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1068/2123] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:13 2022] DELETE /identity/v3/users/1c0af62709134b0e8bf8ba3c10597b66 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:14.704331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.713725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:14.715885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:14.741084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95d6f1-8bc8-43e6-856d-f10c6d2e894e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:14.845339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:14.845994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:14.846280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:14.846553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] PATH_INFO: `/v3/projects/e735c8b690184e7389157da61f37123f` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:14.847958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e735c8b690184e7389157da61f37123f)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:14.850930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:14.991602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e735c8b690184e7389157da61f37123f', 'request_id': 'req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:15.011183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e735c8b690184e7389157da61f37123f', 'request_id': 'req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:15.011183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e735c8b690184e7389157da61f37123f', 'request_id': 'req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:15.129624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] The token cache is being invalidate because project e735c8b690184e7389157da61f37123f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:15.130116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:15.131089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-70cfaf2c-865e-41aa-bb0e-fdd36e0c300d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:15.133178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1056/2124] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:14 2022] DELETE /identity/v3/projects/e735c8b690184e7389157da61f37123f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:15.143222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.151576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.151576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.151576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:15.167222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:15.168565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:15.246067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1069/2125] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:15.250005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.250005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.250005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.274517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:15.276664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:15.286255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1057/2126] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:15.291477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.305067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdc1f1-b9da-4dea-9fb2-592c12b2dc4e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.308117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.308769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.309123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.309327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.317039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:15.317039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.317039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:15.325357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1070/2127] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:15.332304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.345751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f4940-dd51-4463-91cd-9451b17be553 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.350796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.351423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.351703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.351980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.352710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.354619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:15.510936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1058/2128] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:15 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:15.514267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.538950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4e2bc-f660-4087-80d9-db5128d9ce8b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.635044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.636260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.639285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.639285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.639285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.644023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:15.856144 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1071/2129] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:15 2022] POST /identity/v3/users => generated 288 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:15.862025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.874691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321998c-85fb-4464-98c6-9e9a63f03ae2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.880978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.881620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.881906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.882182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.882852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.884851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:15.905518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1059/2130] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:15.910528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.921399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab63d5-d062-4e5f-9e64-33ba5bb101e6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.927803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.929874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.929874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.929874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.929874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.931272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f03ddb-6f70-4885-9724-10c6bb4cd968 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:15.943100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1072/2131] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:15.947602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:15.958408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82998c90-2add-4002-be26-f4c1f1715894 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:15.963463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:15.964317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:15.964606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:15.964893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] PATH_INFO: `/v3/projects/c6803fe8e73b4eb891bb089e109d623c/users/eb5ea5078e09484b9f45517963311fdd/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:15.983858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6803fe8e73b4eb891bb089e109d623c, user_id=eb5ea5078e09484b9f45517963311fdd, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:15.986113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:16.091651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1060/2132] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:15 2022] PUT /identity/v3/projects/c6803fe8e73b4eb891bb089e109d623c/users/eb5ea5078e09484b9f45517963311fdd/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:16.106655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:16.106939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:16.107248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:16.139585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] MFA Rules not processed for user `eb5ea5078e09484b9f45517963311fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:16.143390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:16.218935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1073/2133] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:16.235684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:16.237498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:16.304087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c33b58-b434-41e7-966e-326d4ae4a306 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:16.308705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:16.309396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:16.309677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:16.309965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:16.319481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:16.320974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ff19e-9e55-4b6e-b502-f7067ced1726 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:16.332079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1061/2134] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:17.948759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:17.959102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0106698-f0db-42d4-a503-be1ddd785d2e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:17.962685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:17.963292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:17.963568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:17.963841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:17.965606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:17.973894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:18.033347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:18.034787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:18.044558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1074/2135] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:18.354387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:19.604837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:19.639735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:19.689938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ad68-b50b-4f5c-8e8b-e6c4dba41002 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:19.690220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ad68-b50b-4f5c-8e8b-e6c4dba41002 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:19.690499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ad68-b50b-4f5c-8e8b-e6c4dba41002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:19.711344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6a22ad68-b50b-4f5c-8e8b-e6c4dba41002 None None] MFA Rules not processed for user `eb5ea5078e09484b9f45517963311fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:19.712636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6a22ad68-b50b-4f5c-8e8b-e6c4dba41002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:19.719988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1062/2136] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:20.609453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:20.825400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:21.582849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:21.704945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:22.151738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:22.357335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:22.597935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:22.599110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:22.684413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1cd18-6265-4eeb-812f-cce9f775eb3d service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:22.689525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:22.689924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:22.696166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:22.696166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] PATH_INFO: `/v3/users/f0aaac875caf4997bcfe3e05c222a9c5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:22.696166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0aaac875caf4997bcfe3e05c222a9c5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:22.696166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:22.859765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:23.017837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0aaac875caf4997bcfe3e05c222a9c5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:23.465257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0aaac875caf4997bcfe3e05c222a9c5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:23.479231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0aaac875caf4997bcfe3e05c222a9c5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:23.480053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0aaac875caf4997bcfe3e05c222a9c5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:23.488388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0aaac875caf4997bcfe3e05c222a9c5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:23.495949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1075/2137] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:22 2022] DELETE /identity/v3/users/f0aaac875caf4997bcfe3e05c222a9c5 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:23.499620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168237-814a-4152-8944-0976f4024e5a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:23.500108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168237-814a-4152-8944-0976f4024e5a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:23.500214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72168237-814a-4152-8944-0976f4024e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:23.520740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-72168237-814a-4152-8944-0976f4024e5a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:23.524726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-72168237-814a-4152-8944-0976f4024e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:23.524726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:23.591493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1063/2138] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:23.601894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:23.604407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:23.674239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d954543-181a-4111-b7f4-b15b1c8a3b35 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:23.678104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:23.678714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:23.678990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:23.679267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:23.689108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:23.694158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789cd30-ad4e-4716-9cb2-7655396223a5 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:23.700520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1076/2139] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:24.232030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168237-814a-4152-8944-0976f4024e5a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:24.237327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-72168237-814a-4152-8944-0976f4024e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:24.247783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72168237-814a-4152-8944-0976f4024e5a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:24.253321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:24.254149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:24.254610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:24.255082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] PATH_INFO: `/v3/projects/62d74fd26ee44391b4c3013f240c3327` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:24.256460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d74fd26ee44391b4c3013f240c3327)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:24.258555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:24.354337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.410427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d74fd26ee44391b4c3013f240c3327', 'request_id': 'req-d50119bf-fa14-41de-961a-411d5ca9adb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:24.418287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d74fd26ee44391b4c3013f240c3327', 'request_id': 'req-d50119bf-fa14-41de-961a-411d5ca9adb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:24.433168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d74fd26ee44391b4c3013f240c3327', 'request_id': 'req-d50119bf-fa14-41de-961a-411d5ca9adb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:24.530923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.536292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] The token cache is being invalidate because project 62d74fd26ee44391b4c3013f240c3327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:24.536592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:24.537248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-d50119bf-fa14-41de-961a-411d5ca9adb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:24.539033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1064/2140] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:24 2022] DELETE /identity/v3/projects/62d74fd26ee44391b4c3013f240c3327 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:24.543932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:24.544278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:24.544560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:24.564430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:24.565662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:24.628723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1077/2141] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:24.637797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:24.637970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:24.638252 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:24.671415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:24.672695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:24.681259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1065/2142] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:24.688594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:24.698576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6835b91-85b0-48e3-bb3b-2921b5c8324a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:24.704514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:24.708287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:24.708287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:24.708287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:24.708287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:24.708287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:24.708726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:24.721645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1078/2143] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:24.726453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:24.736359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a30c4-c3fb-45ff-9826-c101a903aca1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:24.741339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:24.741940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:24.742225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:24.742500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:24.743202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:24.745166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:24.865243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1066/2144] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:24 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:24.866717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:24.879546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463254-cd81-4956-8bc1-3849506db6e1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:24.890570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.008366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:25.009062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.009534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.009896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.010547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:25.012687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:25.064264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.173079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.177430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1079/2145] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:24 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:25.182112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:25.199361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7146-7fd2-4d60-b2c6-7c6939a54642 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:25.205691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:25.206605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.207187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.207630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.208541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:25.210347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:25.231525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1067/2146] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:25.236856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:25.261558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3354f-ccbd-4260-bc4f-9ba5f65050ef admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:25.276936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:25.276936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.276936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.276936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.277348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:25.278007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe06342-8515-4a97-a91d-950ed549739e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:25.292238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1080/2147] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:25.295214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:25.307022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14603c80-66c3-43d8-88b9-29ab1f00f8d7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:25.311882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:25.312649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.321332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.321332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] PATH_INFO: `/v3/projects/8961d5ef45304dccbbceb02d2817e022/users/1b83ea8a09264c22b9b76af8b968f30e/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.329086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8961d5ef45304dccbbceb02d2817e022, user_id=1b83ea8a09264c22b9b76af8b968f30e, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:25.331724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:25.436062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1068/2148] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:25 2022] PUT /identity/v3/projects/8961d5ef45304dccbbceb02d2817e022/users/1b83ea8a09264c22b9b76af8b968f30e/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:25.437783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.438879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.439275 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.469769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] MFA Rules not processed for user `1b83ea8a09264c22b9b76af8b968f30e`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:25.472472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:25.547046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1081/2149] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:25.559506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:25.561866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:25.634675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20a00a8-17fe-4d47-a071-b551c8180ad4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:25.638721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:25.639315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:25.639599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:25.640008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:25.649151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:25.650708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57922da1-c733-42e0-9a3e-a0a5bb5010cc service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:25.661338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1069/2150] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:25.706962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:25.888813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:26.084086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:26.085672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:26.202199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c745eb-d6ca-4a13-82d8-674f2eabd36b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:26.211360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:26.214940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:26.214940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:26.214940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] PATH_INFO: `/v3/users/53fa92803f354286865a01461ac0b74e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:26.214940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fa92803f354286865a01461ac0b74e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:26.217084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:26.497580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c31d-5f4c-4168-b8fe-2f592b2be578 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:26.498115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c31d-5f4c-4168-b8fe-2f592b2be578 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:26.498546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703c31d-5f4c-4168-b8fe-2f592b2be578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:26.524554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fa92803f354286865a01461ac0b74e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:26.534354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e703c31d-5f4c-4168-b8fe-2f592b2be578 None None] MFA Rules not processed for user `07c504cd37184cbfb7cb98e2097b4486`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:26.536705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e703c31d-5f4c-4168-b8fe-2f592b2be578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:26.655874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1070/2151] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:26.665279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fa92803f354286865a01461ac0b74e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:26.683651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fa92803f354286865a01461ac0b74e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:26.684526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fa92803f354286865a01461ac0b74e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:26.693966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fa92803f354286865a01461ac0b74e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:26.707149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1082/2152] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:26 2022] DELETE /identity/v3/users/53fa92803f354286865a01461ac0b74e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:26.712955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:26.712955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:26.712955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:26.739836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:26.741909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:26.825438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1071/2153] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:26.834200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:26.854440 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:26.856383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:26.930520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd804c-dec7-4d26-8a60-1f0be7ee4b96 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:26.935607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:26.936273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:26.936559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:26.936882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:26.953899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:26.959335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:26.974653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1083/2154] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:27.214769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:27.271641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:27.650320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:27.740641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:28.120977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:28.122509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:28.146769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4d52-da68-46a0-b2fd-a30a8875e016 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:28.155476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:28.156137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:28.156487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:28.156766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] PATH_INFO: `/v3/projects/a83a1837d37b4e3d85991bf997f53d71` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:28.158485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83a1837d37b4e3d85991bf997f53d71)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:28.160923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:28.304410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83a1837d37b4e3d85991bf997f53d71', 'request_id': 'req-505be0c8-a023-449a-940b-86e8f7c80bd0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.308863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:28.318989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83a1837d37b4e3d85991bf997f53d71', 'request_id': 'req-505be0c8-a023-449a-940b-86e8f7c80bd0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.324752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83a1837d37b4e3d85991bf997f53d71', 'request_id': 'req-505be0c8-a023-449a-940b-86e8f7c80bd0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.445265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] The token cache is being invalidate because project a83a1837d37b4e3d85991bf997f53d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:28.445638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.446335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.447889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1072/2155] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:28 2022] DELETE /identity/v3/projects/a83a1837d37b4e3d85991bf997f53d71 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:28.452170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:28.463381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef58b0-955a-41df-b8f7-48d39849901a service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:28.537635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:28.538319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:28.538610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:28.538887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] PATH_INFO: `/v3/users/95cf805da3d7449798014220032e5c26` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:28.540038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] RBAC: Authorizing `identity:delete_user(user_id=95cf805da3d7449798014220032e5c26)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:28.542114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:28.817902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95cf805da3d7449798014220032e5c26'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.822896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:28.976735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95cf805da3d7449798014220032e5c26'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.996972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95cf805da3d7449798014220032e5c26'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:28.997770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95cf805da3d7449798014220032e5c26'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.007215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-8c6f79a2-1232-4d23-8d18-30cadcd7462c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95cf805da3d7449798014220032e5c26'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.014298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1084/2156] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:28 2022] DELETE /identity/v3/users/95cf805da3d7449798014220032e5c26 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:29.499467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:29.502600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:29.542938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505be0c8-a023-449a-940b-86e8f7c80bd0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:29.611217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:29.612195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:29.612518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:29.612798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] PATH_INFO: `/v3/projects/295ce4f3fe404c72bfd98064227a98a6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:29.614222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295ce4f3fe404c72bfd98064227a98a6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:29.616236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:29.760989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295ce4f3fe404c72bfd98064227a98a6', 'request_id': 'req-79ecf175-1126-4173-8a1e-815528edad91'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.767468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295ce4f3fe404c72bfd98064227a98a6', 'request_id': 'req-79ecf175-1126-4173-8a1e-815528edad91'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.773705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295ce4f3fe404c72bfd98064227a98a6', 'request_id': 'req-79ecf175-1126-4173-8a1e-815528edad91'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.896598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] The token cache is being invalidate because project 295ce4f3fe404c72bfd98064227a98a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:29.896800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.897421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79ecf175-1126-4173-8a1e-815528edad91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:29.898947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1073/2157] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:29 2022] DELETE /identity/v3/projects/295ce4f3fe404c72bfd98064227a98a6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:29.905576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:29.905576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:29.907266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:29.926598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:29.927815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:29.997669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1085/2158] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:30.008006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.008419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.008796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.040502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:30.041847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:30.051112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1074/2159] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:30.057734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.068968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4d00b8-9b7e-406e-b854-517cf382db10 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.074128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.078601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.091044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1086/2160] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:30.097226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.106981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76afca-bd4b-4af6-8b70-67ce69ac9529 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.112704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.113329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.113613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.113896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.114562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.116555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.223693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1075/2161] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:30 2022] POST /identity/v3/projects => generated 361 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:30.229330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.241314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51631eb4-71f1-4c7c-8b7f-c173ff6ed50b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.302324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:30.313838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.314569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.314951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.315441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.316146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.318587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.417234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1087/2162] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:30 2022] POST /identity/v3/users => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:30.424872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.435782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee478de1-7013-4d2b-b45c-008f2c3e738d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.441023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.441648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.441929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.442239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.442891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.444606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.459024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1076/2163] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:30.460487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.472163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25972bc4-8883-4557-ac75-624f2782cc4f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.476965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.477663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.477887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.478163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.478842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.480582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f41af6-050b-4873-a180-17ba1991ba7c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.497282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1088/2164] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:30.498595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.512882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87e041-213a-43c6-89ae-2355780abf6b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.515213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.515881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.516159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.516998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] PATH_INFO: `/v3/projects/b70421b80ac741dba1a20dba76b7fdb2/users/6707cc45a07446df9d17ad4959f80e84/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.535100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70421b80ac741dba1a20dba76b7fdb2, user_id=6707cc45a07446df9d17ad4959f80e84, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.538226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.542843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:30.623543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1077/2165] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:30 2022] PUT /identity/v3/projects/b70421b80ac741dba1a20dba76b7fdb2/users/6707cc45a07446df9d17ad4959f80e84/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:30.636035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.636357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.636641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.672775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] MFA Rules not processed for user `6707cc45a07446df9d17ad4959f80e84`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:30.674186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:30.743338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1089/2166] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:30.783545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.785428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:30.842648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eae9b6-f31e-4cf8-a7dd-7d834d4a1016 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.846951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.847560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.847842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.848121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.856814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.858250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58dd5f-7cfb-4699-8a1a-b327fc14f4c5 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:30.867324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1078/2167] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:30.882928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:30.884414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:30.948167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678a749-88ea-451e-8bb5-ed9129164261 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:30.953079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:30.953837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:30.954678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:30.954958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] PATH_INFO: `/v3/users/6707cc45a07446df9d17ad4959f80e84` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:30.956118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6707cc45a07446df9d17ad4959f80e84)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:30.958227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:31.140579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6707cc45a07446df9d17ad4959f80e84'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:31.237116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6707cc45a07446df9d17ad4959f80e84'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:31.251886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6707cc45a07446df9d17ad4959f80e84'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:31.252720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6707cc45a07446df9d17ad4959f80e84'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:31.266860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6707cc45a07446df9d17ad4959f80e84'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:31.280547 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1090/2168] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:30 2022] DELETE /identity/v3/users/6707cc45a07446df9d17ad4959f80e84 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:31.285362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:31.285643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:31.289205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:31.305940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:31.307172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:31.314489 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:31.369967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1079/2169] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:31.387204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:31.387733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:31.475888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41550a59-4796-4339-a168-3bcf902ab0a6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:31.479843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:31.480499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:31.480780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:31.481055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:31.491949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:31.494361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0416f79-952d-405e-988e-d53ddc9fbd23 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:31.505890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1091/2170] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:31.886129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:32.029945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.032172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:32.045804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:32.056255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f3f26-3bf4-4ffe-86ca-3fd17131c18f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.062689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.064616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.064616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.065123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] PATH_INFO: `/v3/projects/b70421b80ac741dba1a20dba76b7fdb2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.066270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70421b80ac741dba1a20dba76b7fdb2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.068194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.203388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70421b80ac741dba1a20dba76b7fdb2', 'request_id': 'req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:32.213669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70421b80ac741dba1a20dba76b7fdb2', 'request_id': 'req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:32.220714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70421b80ac741dba1a20dba76b7fdb2', 'request_id': 'req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:32.328877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] The token cache is being invalidate because project b70421b80ac741dba1a20dba76b7fdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:32.330057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:32.330795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-baa7b21c-3af9-4dbc-8a0d-088dac2e544d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:32.332636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1080/2171] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:32 2022] DELETE /identity/v3/projects/b70421b80ac741dba1a20dba76b7fdb2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:32.337622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.337906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.338192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.359605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:32.361014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:32.435247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1092/2172] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:32.450197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.450197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.450197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.471554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:32.474917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:32.476250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:32.485013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1081/2173] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:32.489563 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.500267 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1004c-c04e-409c-b205-c6df7186a03d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.505766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.510479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.523180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1093/2174] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:32.527623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.537958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802b85b-03d8-4a75-8354-76d53e55f29c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.543689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.544454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.544735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.545009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.545679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.547735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.672619 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1082/2175] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:32 2022] POST /identity/v3/projects => generated 395 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:32.676731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.737518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2f001-6a3f-42bf-90d1-2b0bf3ea4e36 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.809379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.810048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.810289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.810652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.811308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.813298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.917364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1094/2176] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:32 2022] POST /identity/v3/users => generated 298 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:32.921620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.932723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b7885-eb60-4c58-83a3-eafe8eb30b20 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.937250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.937856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.938138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.938977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.939635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.941284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.951653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1083/2177] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:32.955720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:32.966553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2899f-7362-4122-9449-a69235385a42 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:32.971339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:32.971942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:32.972249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:32.972530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:32.973171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:32.974794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a614d-9737-43fa-892d-aa17eb6109f0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:32.986236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1095/2178] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:32.990647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:33.001533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1500833-7e72-4ee4-84f2-6a491c534861 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:33.006114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:33.006753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:33.007034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:33.007305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] PATH_INFO: `/v3/projects/db02438b6cff46db9a4773e8dd66d937/users/54d87c790a3e4854a9d7e27d158ccc08/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:33.021947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db02438b6cff46db9a4773e8dd66d937, user_id=54d87c790a3e4854a9d7e27d158ccc08, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:33.024650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:33.030932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:33.112311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1084/2179] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:32 2022] PUT /identity/v3/projects/db02438b6cff46db9a4773e8dd66d937/users/54d87c790a3e4854a9d7e27d158ccc08/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:33.123769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:33.124395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:33.124395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:33.154342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] MFA Rules not processed for user `54d87c790a3e4854a9d7e27d158ccc08`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:33.155585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:33.221389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1096/2180] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:33.232786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:33.234557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:33.293349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6412a-55c4-4a3e-8798-8c747aa51f27 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:33.297036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:33.297635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:33.298452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:33.298730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:33.309130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:33.310776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418b8db-f393-419a-9cf1-637b3fd78240 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:33.320920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1085/2181] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:33 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:33.469431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:34.003988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:34.194946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:34.828807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:35.158441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:35.782673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:36.289219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:36.373587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:36.456075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:36.457757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:36.530739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e999286-08b5-40ac-b67c-07971d403b1d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:36.535376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:36.536007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:36.536323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:36.536610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] PATH_INFO: `/v3/users/ce2a01df144a4c69a65798476f01235c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:36.537731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2a01df144a4c69a65798476f01235c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:36.539716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:36.558661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:36.931460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2a01df144a4c69a65798476f01235c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:37.040092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2a01df144a4c69a65798476f01235c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:37.053393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2a01df144a4c69a65798476f01235c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:37.054107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2a01df144a4c69a65798476f01235c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:37.061519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2a01df144a4c69a65798476f01235c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:37.073395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1097/2182] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:36 2022] DELETE /identity/v3/users/ce2a01df144a4c69a65798476f01235c => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:37.078092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:37.078566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:37.078737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:37.100091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:37.101409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:37.163228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1086/2183] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:37.173885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:37.175950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:37.263210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c51f-5cc2-48f4-a2da-fe25a0f9a92a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:37.275082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:37.276862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:37.279110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:37.279606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:37.291257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:37.293060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d89149-1316-4f48-9adf-4485c6ac1631 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:37.306679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1098/2184] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:37.371298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:37.418145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:37.697679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:37.851259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:37.853131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:37.867072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f6a61-be49-42c5-8862-3569e7dcb0b9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:37.872778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:37.873717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:37.874230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:37.874705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] PATH_INFO: `/v3/projects/5721bae3fdf74dec91d53a7dd780b263` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:37.876468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5721bae3fdf74dec91d53a7dd780b263)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:37.879223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:37.983618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:38.053515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5721bae3fdf74dec91d53a7dd780b263', 'request_id': 'req-09b22a00-deee-4a42-9e9a-0a750e87fa0d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:38.060190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5721bae3fdf74dec91d53a7dd780b263', 'request_id': 'req-09b22a00-deee-4a42-9e9a-0a750e87fa0d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:38.066914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5721bae3fdf74dec91d53a7dd780b263', 'request_id': 'req-09b22a00-deee-4a42-9e9a-0a750e87fa0d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:38.141116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] The token cache is being invalidate because project 5721bae3fdf74dec91d53a7dd780b263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:38.142255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:38.142762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09b22a00-deee-4a42-9e9a-0a750e87fa0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:38.144299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1087/2185] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:37 2022] DELETE /identity/v3/projects/5721bae3fdf74dec91d53a7dd780b263 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:38.149281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.149572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.149854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.170684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:38.171906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:38.235697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1099/2186] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:38.249900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.249900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.249900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.267269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:38.268449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:38.277239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1088/2187] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:38.281687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.292131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c6a96-e83a-4915-b468-bd5c44e40e88 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.296938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.300179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.300179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.300179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.300179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:38.300179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.300707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.313195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1100/2188] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:38.317921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.330549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dafe9-7b27-41e6-a78f-78f7a69e094d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.337665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.340406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.340406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.340406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.340406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.343058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.437088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1089/2189] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:38.441682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.451808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc919-06d0-4ffb-9fd1-0fc23318f631 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.520562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.523172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.523172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.523172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.523172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.524458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.683948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1101/2190] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:38 2022] POST /identity/v3/users => generated 289 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:38.693333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.704967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0cdc5-7ea4-4940-bfb1-a3d4cb976e31 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.722590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.722970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.723299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.723579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.724710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.726419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.745351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1090/2191] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:38.749170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.763398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a0bb4-82af-4530-9857-a57ce0bab049 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.769949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.770767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.772280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.772280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.772280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.774117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a5677-7539-4692-9648-72e7ceb03f7a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.794237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1102/2192] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:38.799043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:38.823248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b316a-044c-41fd-b831-dbbf509c5e22 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:38.834456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:38.835774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:38.839748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:38.839748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] PATH_INFO: `/v3/projects/4e744da6ff074b2fb96bd7c8edc6e839/users/7183748fde554bc48867eeceae99b11a/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:38.868047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e744da6ff074b2fb96bd7c8edc6e839, user_id=7183748fde554bc48867eeceae99b11a, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:38.876165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:38.990111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1091/2193] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:38 2022] PUT /identity/v3/projects/4e744da6ff074b2fb96bd7c8edc6e839/users/7183748fde554bc48867eeceae99b11a/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:39.002514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:39.002833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:39.003145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:39.034516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] MFA Rules not processed for user `7183748fde554bc48867eeceae99b11a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:39.034516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:39.072054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:39.129491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1103/2194] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:39.141025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:39.142845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:39.206104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec124e-4b10-4070-b11d-4c19053cc364 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:39.210327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:39.211499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:39.211717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:39.212195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:39.225258 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:39.226860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdf199-0e54-45d4-b76d-d2439599387f service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:39.238261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1092/2195] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:39.683449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:40.088717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:40.088717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:40.210155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b50e-3e8e-4741-b6bb-2eef7d0898fb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:40.216924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:40.218045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:40.218502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:40.218965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] PATH_INFO: `/v3/users/1b83ea8a09264c22b9b76af8b968f30e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:40.232439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b83ea8a09264c22b9b76af8b968f30e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:40.232439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:40.464833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b83ea8a09264c22b9b76af8b968f30e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:40.557761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b83ea8a09264c22b9b76af8b968f30e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:40.583845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b83ea8a09264c22b9b76af8b968f30e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:40.584817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b83ea8a09264c22b9b76af8b968f30e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:40.593952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b83ea8a09264c22b9b76af8b968f30e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:40.601150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1104/2196] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:40 2022] DELETE /identity/v3/users/1b83ea8a09264c22b9b76af8b968f30e => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:40.605901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:40.606534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:40.606534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:40.631447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:40.632736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:40.737120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1093/2197] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:40.752579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:40.754518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:40.836668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c9aab-4195-4fc3-9080-450bcef66222 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:40.840826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:40.843556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:40.843556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:40.843556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:40.858702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:40.858702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede6c65-04a1-4aeb-bb7a-5cad1e2c13ab service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:40.871899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1105/2198] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:41.083838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:41.434842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:41.434842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:41.451179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5571518-f0ce-4cc6-a1d4-7517b8a265e1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:41.459600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:41.460774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:41.461058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:41.461329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] PATH_INFO: `/v3/projects/8961d5ef45304dccbbceb02d2817e022` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:41.462800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8961d5ef45304dccbbceb02d2817e022)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:41.465150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:41.640137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8961d5ef45304dccbbceb02d2817e022', 'request_id': 'req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:41.648621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8961d5ef45304dccbbceb02d2817e022', 'request_id': 'req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:41.655007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8961d5ef45304dccbbceb02d2817e022', 'request_id': 'req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:41.772391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] The token cache is being invalidate because project 8961d5ef45304dccbbceb02d2817e022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:41.772744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:41.773410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-76bbbd3a-6919-404f-bffd-6ccbdbdf26dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:41.774923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1094/2199] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:41 2022] DELETE /identity/v3/projects/8961d5ef45304dccbbceb02d2817e022 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:41.781582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:41.782058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:41.782163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:41.807898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:41.809430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:41.828915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:41.886727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1106/2200] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:41.903977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:41.903977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:41.903977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:41.928793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:41.928793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:41.932956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1095/2201] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:41.937407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:41.953294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ebc8-1286-46c1-9f5d-b0d27299e1a0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:41.959254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:41.959876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:41.960166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:41.960494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:41.961151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:41.961457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:41.963176 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:41.982332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1107/2202] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:41.983167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:41.995014 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aba6e6-8b1f-4cbf-a22b-e62e4877bd26 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.004449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.011286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.011286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.011286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.011286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.011286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.166856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1096/2203] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:41 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:42.171150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.181417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dbf20-f592-4024-9798-b46b91c2440c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.241872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.242544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.242864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.243233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.243920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.246014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.370068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1108/2204] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:42 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:42.377205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.390866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c7bbc-ea96-4b94-bf3d-6af120908e83 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.396176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.397051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.397699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.398131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.399078 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.400935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.412286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1097/2205] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:42.417070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.429279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a56b74-05fe-4764-b698-ca8aa1e4095a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.435946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.436833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.437125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.437400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.438063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.440287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.455420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1109/2206] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:42.460983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.473823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cdcd-65c2-4529-8fc5-f060a5c68311 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.480120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.480832 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.481116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.481826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] PATH_INFO: `/v3/projects/2b2e8271289d4db8a25ad33af69d7ce5/users/777688290ec042089fc44f35d1353714/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.505734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2e8271289d4db8a25ad33af69d7ce5, user_id=777688290ec042089fc44f35d1353714, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.508678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cac8e-2f58-4e9e-801a-ff9f9c8b5f5c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.552647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.555430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:42.574564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c267-03a3-41f1-b282-fddf80172eb5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.581323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.582646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.583277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.583905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] PATH_INFO: `/v3/users/54d87c790a3e4854a9d7e27d158ccc08` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.585428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54d87c790a3e4854a9d7e27d158ccc08)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.588134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.656415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1098/2207] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:42 2022] PUT /identity/v3/projects/2b2e8271289d4db8a25ad33af69d7ce5/users/777688290ec042089fc44f35d1353714/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:42.667036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.667328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.667607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.697220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] MFA Rules not processed for user `777688290ec042089fc44f35d1353714`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:42.698540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:42.770668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1099/2208] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:42.781894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:42.788489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:42.826010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54d87c790a3e4854a9d7e27d158ccc08'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:42.872639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c28ae5-d40f-436b-8371-110ae429db36 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:42.881631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:42.882869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.883377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.883831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.893376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:42.895683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67308059-a793-4d67-8bb9-26ead00d56f8 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:42.900805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54d87c790a3e4854a9d7e27d158ccc08'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:42.914521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1100/2209] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:42.919173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54d87c790a3e4854a9d7e27d158ccc08'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:42.920048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54d87c790a3e4854a9d7e27d158ccc08'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:42.928944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54d87c790a3e4854a9d7e27d158ccc08'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:42.935671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1110/2210] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:42 2022] DELETE /identity/v3/users/54d87c790a3e4854a9d7e27d158ccc08 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:42.945911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:42.946543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:42.947300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:42.982385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:42.982385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.106512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1101/2211] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:43.117735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:43.119315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.192603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:43.195903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.216183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c208c3-af72-4d12-b6f8-7da2f2bafcb5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:43.216584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5058078f-0e63-4ce7-9f5a-a983fc885bc2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:43.226266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:43.227323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:43.227853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:43.228372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] PATH_INFO: `/v3/users/777688290ec042089fc44f35d1353714` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:43.229798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777688290ec042089fc44f35d1353714)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:43.232062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:43.236766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:43.237720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:43.238471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:43.238910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:43.267373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:43.269087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085838c5-7f0d-491f-a449-0cbe7d59225e service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:43.280446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1111/2212] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:43.431820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777688290ec042089fc44f35d1353714'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:43.443800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777688290ec042089fc44f35d1353714'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:43.444665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777688290ec042089fc44f35d1353714'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:43.451335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777688290ec042089fc44f35d1353714'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:43.537452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777688290ec042089fc44f35d1353714'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:43.548836 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1102/2213] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:43 2022] DELETE /identity/v3/users/777688290ec042089fc44f35d1353714 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:43.549406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:43.549524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:43.549969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:43.578697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:43.594759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.627351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:43.664667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1112/2214] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:43.675731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:43.677866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.745228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9878fc-e774-4480-8709-527841c62341 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:43.749469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:43.750054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:43.750336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:43.751543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:43.767537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:43.769056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c68e7-d1cf-4321-8f81-906819105eb6 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:43.780527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1103/2215] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:43.897775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:43.900441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:43.916552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9ef4-09dd-42df-b4ec-28c4e906de00 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:43.921895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:43.922612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:43.922903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:43.923639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] PATH_INFO: `/v3/projects/db02438b6cff46db9a4773e8dd66d937` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:43.924511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db02438b6cff46db9a4773e8dd66d937)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:43.926599 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.082341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db02438b6cff46db9a4773e8dd66d937', 'request_id': 'req-9eb14df6-1b74-4b37-9d91-cc6ffe262198'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.092059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:44.183407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db02438b6cff46db9a4773e8dd66d937', 'request_id': 'req-9eb14df6-1b74-4b37-9d91-cc6ffe262198'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.190610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db02438b6cff46db9a4773e8dd66d937', 'request_id': 'req-9eb14df6-1b74-4b37-9d91-cc6ffe262198'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.203605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] The token cache is being invalidate because project db02438b6cff46db9a4773e8dd66d937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:44.203907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.204635 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9eb14df6-1b74-4b37-9d91-cc6ffe262198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.206234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1113/2216] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:43 2022] DELETE /identity/v3/projects/db02438b6cff46db9a4773e8dd66d937 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:44.211707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.214844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.214844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.236591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:44.237919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:44.304844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1104/2217] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:44.312682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.312974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.313305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.339078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:44.340610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:44.350832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1114/2218] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:44.354482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.365135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06839cbd-375c-4cd4-a46a-5cebeb14768e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.370309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.370954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.371242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.371511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.372167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:44.372507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.374106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.386576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1105/2219] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:05:44.391110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.400677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae68d3-fff5-4299-b3c9-fba451c9e9b1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.405640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.406252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.406610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.408408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.409529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.411739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.521884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.523627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:44.543584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfd82-222c-4d58-9a35-a5c342b19d53 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.550728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.551389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.551729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.552164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] PATH_INFO: `/v3/projects/2b2e8271289d4db8a25ad33af69d7ce5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.553525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2e8271289d4db8a25ad33af69d7ce5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.556427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.576840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1115/2220] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:44 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:44.579014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.680708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f566ff-0b39-4955-b54a-7b05b520188e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.685594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.686208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.686492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.686770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.687479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.689434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.781304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2e8271289d4db8a25ad33af69d7ce5', 'request_id': 'req-843a32f1-cbc8-44f8-abcb-22b83ef82767'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.788949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2e8271289d4db8a25ad33af69d7ce5', 'request_id': 'req-843a32f1-cbc8-44f8-abcb-22b83ef82767'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.796366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2e8271289d4db8a25ad33af69d7ce5', 'request_id': 'req-843a32f1-cbc8-44f8-abcb-22b83ef82767'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.823753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1116/2221] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:44 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:44.825011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.837321 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a5b59-08ed-4e41-83a9-4f8d21802ecd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.916896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.917634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.918009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.918383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.919307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.921051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.936951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1117/2222] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:44.938029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.942661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] The token cache is being invalidate because project 2b2e8271289d4db8a25ad33af69d7ce5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:44.943490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.947422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-843a32f1-cbc8-44f8-abcb-22b83ef82767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:44.952293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0504-d202-4c2e-8e74-a6d10eac4617 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:44.952668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1106/2223] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:44 2022] DELETE /identity/v3/projects/2b2e8271289d4db8a25ad33af69d7ce5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:44.957846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d007-18cd-4d13-81a9-5d750d5bb90f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.958364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d007-18cd-4d13-81a9-5d750d5bb90f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.958797 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669d007-18cd-4d13-81a9-5d750d5bb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.963548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:44.964279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:44.964650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:44.965155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:44.965901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:44.968235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:44.989558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1118/2224] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:44.991587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:44.993939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.012084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfaea6-b468-4db5-b928-6f467cc69e6a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.014757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a669d007-18cd-4d13-81a9-5d750d5bb90f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:45.016109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a669d007-18cd-4d13-81a9-5d750d5bb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.019137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.019754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.020225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.020608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] PATH_INFO: `/v3/projects/c7171fcc75334d32b0491a00449fff92/users/c75ec05a36e54b4e946f4258e65eb1f7/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.029759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1107/2225] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:45.042463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.042851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.043330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.043545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7171fcc75334d32b0491a00449fff92, user_id=c75ec05a36e54b4e946f4258e65eb1f7, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.046359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ab2962-6aef-412f-8125-033b8d19e514 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.069511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:45.074235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.081182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1108/2226] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:45.085051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.097268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc798f-0879-40c6-aed7-2f13b9add741 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.102573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.103285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.103626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.104054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.104949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:45.105243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.110275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.119342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1109/2227] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:05:45.123826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.134994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed8f25-b12e-452c-9198-41b094a5e490 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.139844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.140481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.140762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.141034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.142433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.144224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.150384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1119/2228] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:44 2022] PUT /identity/v3/projects/c7171fcc75334d32b0491a00449fff92/users/c75ec05a36e54b4e946f4258e65eb1f7/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:45.159545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.159875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.160286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.182232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:45.183467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.244574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1120/2229] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:45.258019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.259676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.263440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1110/2230] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:45.270172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.325909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85d85f-5083-4539-8595-beda7bce8a4c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.342227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b802-d51a-4acf-b505-408dccc2e705 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.347903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.348543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.349542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.349542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.349751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.351754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.385829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.386520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.386800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.387073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.397119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.398578 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.412943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1121/2231] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:45.469168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1111/2232] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:45.470758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.480651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5994eb-f6e3-4c0b-ac78-80e10f3b74d8 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.486734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.492426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.492426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.492426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.492426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.492426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.504480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1122/2233] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:45.505925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.516059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f2383b-2631-4241-9822-c93801cbf6a0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.520899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.521765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.524331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.524810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.525701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.527559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6faec1-a4e4-44bb-90a1-d5eebe6d2065 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.549941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1112/2234] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:45.553824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.572742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb582ed-1c9e-498a-b34a-255651a2d9da admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.578597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.579735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.580127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.580516 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] PATH_INFO: `/v3/projects/e599020b766940f4a701c101f885fa1b/users/4261a5ad43ff44e8877dfe8734986857/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.601608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e599020b766940f4a701c101f885fa1b, user_id=4261a5ad43ff44e8877dfe8734986857, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.604523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:45.694488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1123/2235] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:45 2022] PUT /identity/v3/projects/e599020b766940f4a701c101f885fa1b/users/4261a5ad43ff44e8877dfe8734986857/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:45.707334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a705-eb05-4943-944f-814dd01322df None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.707890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a705-eb05-4943-944f-814dd01322df None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.708360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3a705-eb05-4943-944f-814dd01322df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.744554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-03e3a705-eb05-4943-944f-814dd01322df None None] MFA Rules not processed for user `4261a5ad43ff44e8877dfe8734986857`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:45.746365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-03e3a705-eb05-4943-944f-814dd01322df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:45.779553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:45.838565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1113/2236] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:45.846054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:45.967221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b2faa-02b7-4081-859a-4ae516c96e34 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:45.973741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:45.975140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:45.975140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:45.975140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:45.975614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:45.977835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.100869 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1124/2237] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:45 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:46.105527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a705-eb05-4943-944f-814dd01322df None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.127126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3a705-eb05-4943-944f-814dd01322df None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.176617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:46.191713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.192372 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.192788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.193065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.193724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.195703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.340256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1114/2238] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:46 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:46.342523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.353638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740180a-3a11-4b2f-a830-336fdbbeb98d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.358903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.359783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.360294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.360656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.361555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.364276 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.382059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1125/2239] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:46.383366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.395130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b4c21-af72-4082-80e0-cc5c60d7904b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.401132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.401813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.402094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.402374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] PATH_INFO: `/v3/projects/c68041e446244a5a93a3a99c1783c610/users/d448aad3708a4682b0f496b4b611e404/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.420974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68041e446244a5a93a3a99c1783c610, user_id=d448aad3708a4682b0f496b4b611e404, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.423727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.567935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1115/2240] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:46 2022] PUT /identity/v3/projects/c68041e446244a5a93a3a99c1783c610/users/d448aad3708a4682b0f496b4b611e404/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:46.572082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.583938 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc17b06-c947-4169-aa2c-dedf93e7314e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.669900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.670689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.671091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.671468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.672484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.675752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d610e-f096-4e79-a81d-df74f4e8b527 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.696818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1126/2241] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:46.696965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.708187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18867c2-2be4-410f-b78c-287690278830 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.713189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.713865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.714140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.714416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] PATH_INFO: `/v3/projects/c68041e446244a5a93a3a99c1783c610/users/d448aad3708a4682b0f496b4b611e404/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.718277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68041e446244a5a93a3a99c1783c610, user_id=d448aad3708a4682b0f496b4b611e404, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.721325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.733505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1116/2242] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:46 2022] PUT /identity/v3/projects/c68041e446244a5a93a3a99c1783c610/users/d448aad3708a4682b0f496b4b611e404/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:46.743721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.744016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.744362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.775910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] MFA Rules not processed for user `d448aad3708a4682b0f496b4b611e404`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:46.777205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:46.849731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1127/2243] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:46.861539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:46.863418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:46.955157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bf60c-2fbb-4c43-ac8f-6f91ad9aa23e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:46.970515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:46.971168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:46.971492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:46.971768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:46.984110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:46.984110 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61271f-64c4-4b8b-b910-8ab5d5529cec service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:46.997841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1117/2244] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:47.656415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:48.038232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:48.108616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:48.250442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21014-58b5-4ae7-ae65-74fe93d38cc5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:48.256531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:48.257192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.257480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.257894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] PATH_INFO: `/v3/users/4261a5ad43ff44e8877dfe8734986857` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.259395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4261a5ad43ff44e8877dfe8734986857)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:48.266466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.490042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4261a5ad43ff44e8877dfe8734986857'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.563085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4261a5ad43ff44e8877dfe8734986857'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.580548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4261a5ad43ff44e8877dfe8734986857'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.581551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4261a5ad43ff44e8877dfe8734986857'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.596753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4261a5ad43ff44e8877dfe8734986857'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:48.604809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1128/2245] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:48 2022] DELETE /identity/v3/users/4261a5ad43ff44e8877dfe8734986857 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:48.613942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.614237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.615478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.645946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:48.648754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:48.738762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1118/2246] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:48.754621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:48.757302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:48.849820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821f76-fd57-4574-9be0-5dc3453e970a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:48.855575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:48.857329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:48.857623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:48.858082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:48.872640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:48.874316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:48.889572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1129/2247] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:49.059180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:49.802814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:49.804331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:49.821813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1035fc89-0345-4985-9fa2-188c0662db1d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:49.832802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:49.833579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:49.834051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:49.834492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] PATH_INFO: `/v3/projects/e599020b766940f4a701c101f885fa1b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:49.835891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e599020b766940f4a701c101f885fa1b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:49.838212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:49.998436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e599020b766940f4a701c101f885fa1b', 'request_id': 'req-355a2fca-5ad2-4db0-abc1-9e5652034be1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.010060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e599020b766940f4a701c101f885fa1b', 'request_id': 'req-355a2fca-5ad2-4db0-abc1-9e5652034be1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.017646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e599020b766940f4a701c101f885fa1b', 'request_id': 'req-355a2fca-5ad2-4db0-abc1-9e5652034be1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.106176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] The token cache is being invalidate because project e599020b766940f4a701c101f885fa1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:50.106580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.107309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-355a2fca-5ad2-4db0-abc1-9e5652034be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.109525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1119/2248] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:49 2022] DELETE /identity/v3/projects/e599020b766940f4a701c101f885fa1b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:50.115348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:50.131911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15197b77-ac3a-4d3f-a0b6-890e57385e02 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:50.224442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:50.225251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:50.225768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:50.226130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] PATH_INFO: `/v3/users/d448aad3708a4682b0f496b4b611e404` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:50.228711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d448aad3708a4682b0f496b4b611e404)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:50.230783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:50.404426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:50.515429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd448aad3708a4682b0f496b4b611e404'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.633098 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd448aad3708a4682b0f496b4b611e404'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.651934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd448aad3708a4682b0f496b4b611e404'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.653032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd448aad3708a4682b0f496b4b611e404'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.667892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd448aad3708a4682b0f496b4b611e404'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:50.676219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1130/2249] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:50 2022] DELETE /identity/v3/users/d448aad3708a4682b0f496b4b611e404 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:51.011711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:51.012219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:51.012304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:51.065620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:51.080256 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:51.178492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:51.199288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1120/2250] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:51.263249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:51.266237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:51.299864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:51.303191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:51.376457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06402c-fe15-45dc-a396-747b60837230 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:51.383364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:51.384002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:51.384319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:51.384607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:51.397650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:51.399837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64025ca0-718f-4aeb-affa-621baa6c6864 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:51.418271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1131/2251] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:05:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:51.454076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1127a-459d-4233-87aa-1cf42bd3def7 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:51.465282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:51.466793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:51.471175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:51.471175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] PATH_INFO: `/v3/projects/c68041e446244a5a93a3a99c1783c610` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:51.471175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68041e446244a5a93a3a99c1783c610)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:51.471552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:51.733292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68041e446244a5a93a3a99c1783c610', 'request_id': 'req-05154535-5231-40f3-8e1b-81b25827913d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:51.745413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68041e446244a5a93a3a99c1783c610', 'request_id': 'req-05154535-5231-40f3-8e1b-81b25827913d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:51.757018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68041e446244a5a93a3a99c1783c610', 'request_id': 'req-05154535-5231-40f3-8e1b-81b25827913d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:51.947391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] The token cache is being invalidate because project c68041e446244a5a93a3a99c1783c610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:51.947687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:51.948497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-05154535-5231-40f3-8e1b-81b25827913d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:51.950890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1121/2252] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:51 2022] DELETE /identity/v3/projects/c68041e446244a5a93a3a99c1783c610 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:51.956901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:51.957346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:51.957731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:51.993229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:51.994589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:52.112016 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1132/2253] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:52.120250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.121237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.121718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.149280 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:52.151322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:52.167438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1122/2254] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:52.170549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.181485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54278d25-328d-4178-86d5-4d26d6a0229d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.188651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.190304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.190835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.191374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.193485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:52.194081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.195798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.235449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1133/2255] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:52.237284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.247571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47290db2-4230-4289-ba8c-e452cb89635e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.255021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.255960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.256507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.257283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.257591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.261140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5d4724-e5d0-46da-9280-b7583a13f493 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.432740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1123/2256] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:52.437271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.447933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e831504-76a2-40fa-a36e-e78ece8f8f38 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.460034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.462812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.463207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.502857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] MFA Rules not processed for user `c75ec05a36e54b4e946f4258e65eb1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:52.504991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:52.611405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.613393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.613741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.614286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.614961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.616973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.664128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1124/2257] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:52.666123 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.667485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:52.684508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6e916-f830-40f2-9596-016bfad97e7e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.691057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.691692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.691974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.692274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.693535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.698933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.704160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:52.777063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1134/2258] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/users => generated 286 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:52.780125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.795688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906c6a2-dca2-4e79-a9d8-26d8293fd6a8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.806193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.807944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.808817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.809411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.812483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.813393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d93696-bad3-495e-862b-f6a49472a81d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.832360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1135/2259] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:52.833750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.834042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.835315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.869724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:52.869918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1125/2260] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:05:52.870908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.874919 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:52.875862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:52.963047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82107de9-2021-4ccb-b193-232d8352378e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.968845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.969560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.970791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:52.971162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:52.972006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:52.973877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:52.977239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1136/2261] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:52.978161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.989647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1126/2262] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:52.992793 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e5887-b014-476e-86bf-1daa5de6262e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:52.994800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:52.998532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:52.999245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:52.999647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.000050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.002313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.004978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.008843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c5e48-7fee-4403-8e14-002db8e62e58 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.023987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.023987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.023987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.023987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] PATH_INFO: `/v3/projects/dc7ff6740acd4dd4bd8dd8cf62331c94/users/21015d13def34d43a3bdae4d859acea2/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.041816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7ff6740acd4dd4bd8dd8cf62331c94, user_id=21015d13def34d43a3bdae4d859acea2, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.041816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.144344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1137/2263] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:52 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:53.145707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.147904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:53.152706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1127/2264] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:52 2022] PUT /identity/v3/projects/dc7ff6740acd4dd4bd8dd8cf62331c94/users/21015d13def34d43a3bdae4d859acea2/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:53.155089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.287455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627da1-1dce-457c-9674-08b17da6071f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.304454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631ab69-2b51-4ad0-a570-5c2d74a29d39 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.310714 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.311478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.311767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.312054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.312738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.315148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a759a3-c395-4387-a017-bb139ee415ab admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.327452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1128/2265] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:53.333906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.334240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.334478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.361869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:53.363396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:53.375066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1129/2266] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:53.375472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.395979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d6133-7066-4405-970e-a07fb3f5d19a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.402202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.403665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.412363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.412363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.412672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.412752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] PATH_INFO: `/v3/projects/460ce4c06cf3490699e69e8d883de839/users/041194e4895b4a68ba9a6e5935c783c1/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.412843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.412843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.433412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ce4c06cf3490699e69e8d883de839, user_id=041194e4895b4a68ba9a6e5935c783c1, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.437029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.489576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.491362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.500900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1138/2267] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:05:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:53.502201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.503933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:53.576473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1130/2268] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:53 2022] PUT /identity/v3/projects/460ce4c06cf3490699e69e8d883de839/users/041194e4895b4a68ba9a6e5935c783c1/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:53.580849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.592339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd15639-c591-49cb-b279-37737b30f55e service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.682336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.683536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.683901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.684882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.687045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a212ff-6961-499a-a57e-fb827532b7e4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.694251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.694966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.695281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.695528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.696454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.698015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.699803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.700608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df6a83-b44b-4e6e-a9ce-755f7d7b02b7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.715194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1139/2269] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:53.722319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1131/2270] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:53.730817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:53.758350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908019d-5005-47d3-a691-a96638cc9f17 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:53.764907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:53.765604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:53.766008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:53.766404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] PATH_INFO: `/v3/projects/460ce4c06cf3490699e69e8d883de839/users/041194e4895b4a68ba9a6e5935c783c1/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:53.769152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=460ce4c06cf3490699e69e8d883de839, user_id=041194e4895b4a68ba9a6e5935c783c1, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:53.771930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:53.793411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1140/2271] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:53 2022] PUT /identity/v3/projects/460ce4c06cf3490699e69e8d883de839/users/041194e4895b4a68ba9a6e5935c783c1/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:54.386920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:54.871683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3bfe-12a0-466a-b3e7-1cddd93fadcd None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:54.871683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3bfe-12a0-466a-b3e7-1cddd93fadcd None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:54.871683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b3bfe-12a0-466a-b3e7-1cddd93fadcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:54.900496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-742b3bfe-12a0-466a-b3e7-1cddd93fadcd None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:54.902109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-742b3bfe-12a0-466a-b3e7-1cddd93fadcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:54.996477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1132/2272] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:05:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:55.012268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:55.113509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6e341-6d8f-4719-9c40-98597f0daaae admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:55.130155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:55.130970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:55.132564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:55.132887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:55.152790 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:55.161038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f868e-70fe-43b8-83d2-ef4c521149d3 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:55.180298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1141/2273] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:05:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:55.332049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:55.942162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:55.943241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:55.943241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:55.981520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] MFA Rules not processed for user `21015d13def34d43a3bdae4d859acea2`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:55.983259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:56.119991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.129466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.129466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.142036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1133/2274] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:56.148612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:56.150594 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:56.152547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:56.184322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1142/2275] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:05:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:56.202862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:56.223390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cbf23-b760-43f3-ade8-6d2995391ba1 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:56.229483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:56.230884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.231332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.231872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.248471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:56.253247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:56.269098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccd21c1-0316-40a1-a539-ab99a4b87512 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:56.271813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1143/2276] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:05:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:56.279804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:56.280498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.280783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.281062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.281712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:56.283848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:56.447115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1134/2277] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:56 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:56.451544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:56.474423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5122-39d2-442a-9631-2028e01a6fac service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:56.605812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:56.609807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.609807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.609807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.609807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:56.609807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:56.769255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1144/2278] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:56 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:56.773533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:56.787445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134f840-ef37-4c4b-b8d5-6c69950a74f2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:56.807058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:56.807981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.808296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.808576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.809246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:56.811838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:56.839405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1135/2279] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:56.843654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:56.873296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c841-b522-4fca-9991-e19377111de9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:56.886917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:56.890060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:56.890060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:56.890060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] PATH_INFO: `/v3/projects/b587a012a31e4c97b12811ea2d139f1e/users/accc1eebd34c498692432189061491ac/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:56.940274 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:56.942789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b587a012a31e4c97b12811ea2d139f1e, user_id=accc1eebd34c498692432189061491ac, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:56.946220 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:57.065550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1145/2280] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:56 2022] PUT /identity/v3/projects/b587a012a31e4c97b12811ea2d139f1e/users/accc1eebd34c498692432189061491ac/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:57.082582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:57.103824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7d477-2593-4251-b7c8-db5540a96bb4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:57.252356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:57.253120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:57.253498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:57.253850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:57.254949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:57.256829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dac7f-7269-4b2d-8ab4-2e804ce31011 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:57.275701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1136/2281] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:57.279755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:57.298466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311080a-ab3a-4bb8-a4be-89a31ebc941b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:57.318884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:57.319603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:57.319892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:57.320165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] PATH_INFO: `/v3/projects/b587a012a31e4c97b12811ea2d139f1e/users/accc1eebd34c498692432189061491ac/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:57.325222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b587a012a31e4c97b12811ea2d139f1e, user_id=accc1eebd34c498692432189061491ac, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:57.328234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98819822-42af-4c06-ac03-ec6c5c5338ea admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:57.358747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1146/2282] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:57 2022] PUT /identity/v3/projects/b587a012a31e4c97b12811ea2d139f1e/users/accc1eebd34c498692432189061491ac/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:58.109760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:59.304466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:59.615987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.619718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.619718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.672750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] MFA Rules not processed for user `accc1eebd34c498692432189061491ac`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:59.675455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:59.798668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1137/2283] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:59.810849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.811379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.811479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.844135 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] MFA Rules not processed for user `21015d13def34d43a3bdae4d859acea2`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:59.846851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:59.978662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1147/2284] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:59.986219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.987805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:00.153894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:00.156386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6dabf-5d56-4bad-9678-ddee029f26a4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:00.157277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:00.167345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:00.168247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:00.168537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:00.168858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:00.180009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:00.197670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36b3e0-38d5-431f-a609-7a39f74b7307 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:00.226069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1138/2285] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:00.297968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccf912-1201-40b8-a0ca-ece2bb518f3d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:00.332775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:00.333469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:00.333753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:00.338508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] PATH_INFO: `/v3/users/eb5ea5078e09484b9f45517963311fdd` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:00.339883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5ea5078e09484b9f45517963311fdd)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:00.341889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:00.662881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5ea5078e09484b9f45517963311fdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:00.804180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5ea5078e09484b9f45517963311fdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:00.825341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5ea5078e09484b9f45517963311fdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:00.832318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5ea5078e09484b9f45517963311fdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:00.844147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5ea5078e09484b9f45517963311fdd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:00.857461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:00.858364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:00.858822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:00.862201 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1148/2286] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:00 2022] DELETE /identity/v3/users/eb5ea5078e09484b9f45517963311fdd => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:00.884979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:00.886483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:01.003103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1139/2287] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:01.012197 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:01.014149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:01.117884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede789db-51b9-4d65-a52b-291ee93bcdc2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:01.123839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:01.124774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:01.124939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:01.125338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:01.145874 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:01.147351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e8336-49c0-4a4b-a0d4-8961e134456e service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:01.159808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1149/2288] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:01.261347 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:01.384475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:01.667770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:01.669354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:01.719829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b572d8-a7c9-40c4-b4fc-5d0ed2f2c38b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:01.734082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:01.737475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:01.737943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:01.739752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] PATH_INFO: `/v3/projects/c6803fe8e73b4eb891bb089e109d623c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:01.741428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6803fe8e73b4eb891bb089e109d623c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:01.743848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:01.884858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6803fe8e73b4eb891bb089e109d623c', 'request_id': 'req-933b756d-1e81-4394-9d6c-545666a4b613'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:01.899188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6803fe8e73b4eb891bb089e109d623c', 'request_id': 'req-933b756d-1e81-4394-9d6c-545666a4b613'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:01.912509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6803fe8e73b4eb891bb089e109d623c', 'request_id': 'req-933b756d-1e81-4394-9d6c-545666a4b613'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:02.029157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] The token cache is being invalidate because project c6803fe8e73b4eb891bb089e109d623c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:02.029456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:02.030334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:02.036755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1140/2289] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:01 2022] DELETE /identity/v3/projects/c6803fe8e73b4eb891bb089e109d623c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:02.343055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab6ce-6489-4e9f-aaee-3e206915523f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:02.343610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab6ce-6489-4e9f-aaee-3e206915523f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:02.344009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ab6ce-6489-4e9f-aaee-3e206915523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:02.387946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-859ab6ce-6489-4e9f-aaee-3e206915523f None None] MFA Rules not processed for user `041194e4895b4a68ba9a6e5935c783c1`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:02.389245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-859ab6ce-6489-4e9f-aaee-3e206915523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:02.497637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1150/2290] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:02.515146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:02.516869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:02.580645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b756d-1e81-4394-9d6c-545666a4b613 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:02.585013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:02.585719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:02.585983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:02.586265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:02.588291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:02.653421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:02.654892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:02.665945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1141/2291] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:02.924369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:03.029601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:03.029892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:03.030171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:03.051705 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:03.053013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:03.110898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1151/2292] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:06:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:03.122920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:03.124508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:03.206151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7438-0a26-4d08-bce2-c2aed5bca5be service glance] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:03.216262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:03.216992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:03.217440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:03.217823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:03.229176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:03.230808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd988a3e-4930-4500-b8ad-0a9cb4edc5c8 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:03.240132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1142/2293] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:06:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:03.379759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:04.271984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:04.441548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:04.443962 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:04.558238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278c69f-3b03-4450-94dd-c2a4fa8cb9e5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:04.564741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:04.565644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:04.566142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:04.566572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] PATH_INFO: `/v3/users/7183748fde554bc48867eeceae99b11a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:04.568419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7183748fde554bc48867eeceae99b11a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:04.571676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:05.050026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7183748fde554bc48867eeceae99b11a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:05.200627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7183748fde554bc48867eeceae99b11a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:05.255598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7183748fde554bc48867eeceae99b11a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:05.258618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7183748fde554bc48867eeceae99b11a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:05.275636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7183748fde554bc48867eeceae99b11a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:05.289524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1152/2294] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:04 2022] DELETE /identity/v3/users/7183748fde554bc48867eeceae99b11a => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:05.294088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:05.294088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:05.294088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:05.343493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:05.345196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:05.493115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1143/2295] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:05.509348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:05.510896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:05.731366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f8c5b-745a-46de-acf0-0eca9253c1ad admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:05.745387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:05.746048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:05.750511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:05.750976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:05.801782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:05.804932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e56858-c28c-433f-858a-00121e4c1d6d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:05.875254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1153/2296] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:05.898229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:06.296243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:06.708984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:06.756524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:06.759216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:06.797206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173ad6d-d7d3-4cf8-a81b-1c10376b777e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:06.813026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:06.813889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:06.814422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:06.814842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] PATH_INFO: `/v3/projects/4e744da6ff074b2fb96bd7c8edc6e839` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:06.817653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e744da6ff074b2fb96bd7c8edc6e839)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:06.829464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.117584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e744da6ff074b2fb96bd7c8edc6e839', 'request_id': 'req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.133896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e744da6ff074b2fb96bd7c8edc6e839', 'request_id': 'req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.144746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e744da6ff074b2fb96bd7c8edc6e839', 'request_id': 'req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.225374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] The token cache is being invalidate because project 4e744da6ff074b2fb96bd7c8edc6e839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:07.225374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.225613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a24051fd-581a-4ecb-86b8-ddfc6c9a760c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.231523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1144/2297] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:06 2022] DELETE /identity/v3/projects/4e744da6ff074b2fb96bd7c8edc6e839 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:07.233752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.234410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.234800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.328930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:07.334364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:07.396513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:07.432849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:07.516538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1154/2298] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:07.524631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c464-6e3b-4738-b685-66155219b94a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.525554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c464-6e3b-4738-b685-66155219b94a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.525849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c464-6e3b-4738-b685-66155219b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.597894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8745c464-6e3b-4738-b685-66155219b94a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:07.603272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8745c464-6e3b-4738-b685-66155219b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:07.634685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1145/2299] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:07.634920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.650451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2a184-03ae-458b-aa49-eb5f6cf89b00 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:07.671140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:07.671835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.672315 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.672607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.673294 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:07.673665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:07.676880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.702178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1155/2300] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:06:07.706623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745c464-6e3b-4738-b685-66155219b94a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.723475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745c464-6e3b-4738-b685-66155219b94a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:07.733184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:07.733616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.734029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.734408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.735163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:07.738380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.932167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1146/2301] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:07 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:07.936941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.951371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fba3e-8003-487f-8439-27367ef43210 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:08.019946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:08.152561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:08.153202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:08.153481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:08.154105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:08.154411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:08.158480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:08.635820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1156/2302] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:07 2022] POST /identity/v3/users => generated 289 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:08.641186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:08.671670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ebff1-2da3-4d0b-83a8-aaf3edbf2a17 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:08.680266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:08.687640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:08.687640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:08.687640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:08.687640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:08.687640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:08.705504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1147/2303] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:08.707432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:08.723179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6362b0-8245-45cc-8cdb-d87f46369b61 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:08.730589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:08.731685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:08.732174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:08.732562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:08.733392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:08.735436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f029a-e427-464b-ac90-3ef90c0261a3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:08.781270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1157/2304] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:08.785896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:08.820412 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38dd81-8a46-47ab-8966-1e9a25b353a5 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:08.832432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:08.836920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:08.837509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:08.838156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] PATH_INFO: `/v3/projects/b571f2af1bde4d479de3acf6ac50abe5/users/6b5181a708174c2ca05a129a7a327982/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:08.878163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b571f2af1bde4d479de3acf6ac50abe5, user_id=6b5181a708174c2ca05a129a7a327982, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:08.882218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:08.982189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1148/2305] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:08 2022] PUT /identity/v3/projects/b571f2af1bde4d479de3acf6ac50abe5/users/6b5181a708174c2ca05a129a7a327982/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:08.993846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:08.994477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:08.994969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:09.068873 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] MFA Rules not processed for user `6b5181a708174c2ca05a129a7a327982`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:09.070507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:09.101776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.244814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.257171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:09.257482 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1158/2306] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:09.273662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.354064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.432753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4819eb-c7a0-4163-8f68-c6541c1061e4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:09.445937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:09.448297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:09.448297 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:09.451192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:09.453052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:09.456155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:09.520285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.600835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1149/2307] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:09 2022] POST /identity/v3/projects => generated 375 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:06:09.601086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:09.618164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9d7f-0d8e-4c70-9095-00ab0605bb53 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:09.722470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.771550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:09.772401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:09.773540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:09.774050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:09.775027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:09.777647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:09.873913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1159/2308] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:09 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:09.879840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:09.900815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.918965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75584b5-f704-4a0f-b898-b06c54793c10 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:09.938842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:09.940458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:09.941391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:09.941867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:09.943055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:09.949812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:09.971346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1150/2309] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:09.976052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:09.996000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea04e7-fb65-4187-a220-d25500422ef3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.008332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.008332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.008332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.008332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.010807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.015773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed29840-b2b1-4831-8903-fbbd18beae50 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.038192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1160/2310] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:10.043963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.056495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef7d30-164f-4075-b5f3-621bcbc5601a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.062151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.063230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.063742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.064087 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] PATH_INFO: `/v3/projects/1a6444b9963344cfb4da9c84ceaca000/users/cfe434d313a047188da7aa587a32b39a/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.085216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a6444b9963344cfb4da9c84ceaca000, user_id=cfe434d313a047188da7aa587a32b39a, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.089278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.188330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1151/2311] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:10 2022] PUT /identity/v3/projects/1a6444b9963344cfb4da9c84ceaca000/users/cfe434d313a047188da7aa587a32b39a/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:10.194278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.197269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.197840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.247126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] MFA Rules not processed for user `cfe434d313a047188da7aa587a32b39a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:10.248700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:10.344264 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1161/2312] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:10.348365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.500755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46964d-eb7b-41d5-b126-f9e37f22ac7c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.507038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.507684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.507972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.508282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.508956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.518766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.578566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:10.668997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1152/2313] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:10 2022] POST /identity/v3/projects => generated 377 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:10.670017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.683429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de9336-3af8-4713-95e6-bfd8fc4a9aad None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.779317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.780702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.781138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.785406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.785406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.785406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.902265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1162/2314] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:10 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:10.906045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.922121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa053089-b654-4fe0-8171-7393b0dae32e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.933705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.934349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.934636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.935062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.935740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.937472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.951452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1153/2315] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:10.956411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.988866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252ed21-387e-46f5-aff0-772a7304ed71 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.995809 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.996892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.997497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.997983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] PATH_INFO: `/v3/projects/75d6c2900b9245aabb2ca257e614ba73/users/ed2fe812e4d94916933828af10f4a414/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.024947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d6c2900b9245aabb2ca257e614ba73, user_id=ed2fe812e4d94916933828af10f4a414, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.028875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.098630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1163/2316] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:10 2022] PUT /identity/v3/projects/75d6c2900b9245aabb2ca257e614ba73/users/ed2fe812e4d94916933828af10f4a414/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:11.103129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.123150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073dba9-a8a7-4aa8-bcb8-6e19109a1186 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.138856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:11.222381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.223290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.223863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.224317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.225119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.226927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ad681-02a6-4b55-81f9-4750267b7cd8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.239329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1154/2317] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:11.243808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.265323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dac91-1789-4458-b9ef-a64667a9eadc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.278687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.279568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.279931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.280339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] PATH_INFO: `/v3/projects/75d6c2900b9245aabb2ca257e614ba73/users/ed2fe812e4d94916933828af10f4a414/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.285935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d6c2900b9245aabb2ca257e614ba73, user_id=ed2fe812e4d94916933828af10f4a414, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.292364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.311091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1164/2318] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:11 2022] PUT /identity/v3/projects/75d6c2900b9245aabb2ca257e614ba73/users/ed2fe812e4d94916933828af10f4a414/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:11.342084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dedf3-578e-4083-aae0-4e94ec395067 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.342373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dedf3-578e-4083-aae0-4e94ec395067 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.342647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dedf3-578e-4083-aae0-4e94ec395067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.400614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5e0dedf3-578e-4083-aae0-4e94ec395067 None None] MFA Rules not processed for user `ed2fe812e4d94916933828af10f4a414`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:11.401932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5e0dedf3-578e-4083-aae0-4e94ec395067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:11.518484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1155/2319] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:11.532742 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.535602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:11.605587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:11.618758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63dce8-b7db-4607-9eb2-c8406eea9156 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.624572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.625934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.629641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.629641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.721774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.724511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.738846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1165/2320] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:12.441673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.442312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.442855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.472292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:12.474676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:12.586583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1156/2321] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:12.607941 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.609515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:12.789424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40935de-d4aa-456a-b06a-9b451cea9f1f service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.799077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.799782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.800079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.804554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.822783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.822783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.842526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1166/2322] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:06:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:15.419079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:15.419079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:15.487300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef740-e586-4e7f-8a3a-daf74d68b039 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:15.504795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:15.505446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:15.505865 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:15.506652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:15.661984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:15.714878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:15.718293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf0932-c437-488c-af79-46d767eb307f service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:15.729972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1157/2323] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:18.613882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:18.625859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f70c0-9451-4fe2-b99a-48f70a9d28e6 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:18.631378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:18.632574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:18.633077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:18.633562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:18.645437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:18.647362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e948a3d-c5eb-4bc0-bf5e-b4433ef281e2 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:18.672387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1167/2324] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:19.147549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:19.148154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:19.148293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:19.173643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] MFA Rules not processed for user `c75ec05a36e54b4e946f4258e65eb1f7`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:19.175640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:19.296178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1158/2325] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:20.613517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abf3e-46c6-4ad1-88b5-d78a34c82f3f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:20.614100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abf3e-46c6-4ad1-88b5-d78a34c82f3f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:20.614100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05abf3e-46c6-4ad1-88b5-d78a34c82f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:20.636228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-f05abf3e-46c6-4ad1-88b5-d78a34c82f3f None None] MFA Rules not processed for user `4d3f02b889cb44969b170a61388ce05c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:20.637550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f05abf3e-46c6-4ad1-88b5-d78a34c82f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:20.739027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1168/2326] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:25.028183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.096535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f7d70-1e6f-4cc9-a30f-e5f23b21816b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.101966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.102618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.102901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.103183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] PATH_INFO: `/v3/users/6b5181a708174c2ca05a129a7a327982` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.104582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5181a708174c2ca05a129a7a327982)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.106523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.350270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5181a708174c2ca05a129a7a327982'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:25.386267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5181a708174c2ca05a129a7a327982'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:25.388648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5181a708174c2ca05a129a7a327982'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:25.411728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5181a708174c2ca05a129a7a327982'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:25.524241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5181a708174c2ca05a129a7a327982'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:25.524241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:25.524241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1159/2327] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:25 2022] DELETE /identity/v3/users/6b5181a708174c2ca05a129a7a327982 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:25.534800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95780a-6db6-4a76-9835-1fd0bb1d4192 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.535350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95780a-6db6-4a76-9835-1fd0bb1d4192 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.535350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95780a-6db6-4a76-9835-1fd0bb1d4192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.559040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-cb95780a-6db6-4a76-9835-1fd0bb1d4192 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:25.560851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cb95780a-6db6-4a76-9835-1fd0bb1d4192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:25.582995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:25.646417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1169/2328] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:25.656417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.659040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:25.805060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302f9f5-860b-4d25-85a7-46bf159464e2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.810472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.811470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.811915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.812353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.825212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.828422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.851195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1160/2329] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:26.379167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.379167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.379167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.404249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:26.406070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:26.517604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1170/2330] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:26.531586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.534088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:26.691294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fb67f-a3b5-4dae-8c98-29802f9601a5 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.707556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.708531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.708915 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.709338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.731661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.733792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.757226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1161/2331] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:06:26.838178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.840028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:26.872597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328257-650c-4534-b519-18b8aa372e93 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.882266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.883514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.883890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.884366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] PATH_INFO: `/v3/projects/b571f2af1bde4d479de3acf6ac50abe5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.886767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b571f2af1bde4d479de3acf6ac50abe5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.890364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:27.106410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b571f2af1bde4d479de3acf6ac50abe5', 'request_id': 'req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.189244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b571f2af1bde4d479de3acf6ac50abe5', 'request_id': 'req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.206958 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b571f2af1bde4d479de3acf6ac50abe5', 'request_id': 'req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.240812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] The token cache is being invalidate because project b571f2af1bde4d479de3acf6ac50abe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:27.241112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.243947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.250481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1171/2332] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:26 2022] DELETE /identity/v3/projects/b571f2af1bde4d479de3acf6ac50abe5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:27.255485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:27.275556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94030f-dbe6-4be9-9677-4ffc30479616 service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:27.408727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:27.409332 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:27.409690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:27.409987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] PATH_INFO: `/v3/users/cfe434d313a047188da7aa587a32b39a` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:27.411269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe434d313a047188da7aa587a32b39a)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:27.413620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:27.642007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:27.676916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe434d313a047188da7aa587a32b39a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.747064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe434d313a047188da7aa587a32b39a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.747819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe434d313a047188da7aa587a32b39a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.765818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe434d313a047188da7aa587a32b39a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.882130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe434d313a047188da7aa587a32b39a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:27.890042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1162/2333] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:27 2022] DELETE /identity/v3/users/cfe434d313a047188da7aa587a32b39a => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:29.140724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:29.144029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:29.169745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73169ff-b0cd-4be1-a54f-fe4f29dd4cb0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:29.327350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:29.363062 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:29.363893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:29.364181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:29.364629 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] PATH_INFO: `/v3/projects/1a6444b9963344cfb4da9c84ceaca000` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:29.369885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a6444b9963344cfb4da9c84ceaca000)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:29.372175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:29.410969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:29.412671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:29.562170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a6444b9963344cfb4da9c84ceaca000', 'request_id': 'req-979b3091-b344-4511-b206-5c1d152455e2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:29.571987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f92f2-a56f-4acf-8a75-5d35408407fd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:29.645346 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:29.646253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:29.646697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:29.647146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:29.650267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:29.702413 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a6444b9963344cfb4da9c84ceaca000', 'request_id': 'req-979b3091-b344-4511-b206-5c1d152455e2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:29.710125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a6444b9963344cfb4da9c84ceaca000', 'request_id': 'req-979b3091-b344-4511-b206-5c1d152455e2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:29.736980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] The token cache is being invalidate because project 1a6444b9963344cfb4da9c84ceaca000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:29.746393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:29.746393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:29.747472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1172/2334] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:29 2022] DELETE /identity/v3/projects/1a6444b9963344cfb4da9c84ceaca000 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:29.748627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:29.754913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:29.848023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:29.856767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:29.882397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1163/2335] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:29.895703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b3091-b344-4511-b206-5c1d152455e2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:29.904798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:29.905706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:29.906088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:29.906417 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] PATH_INFO: `/v3/users/ed2fe812e4d94916933828af10f4a414` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:29.907888 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2fe812e4d94916933828af10f4a414)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:29.910239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:30.205646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2fe812e4d94916933828af10f4a414'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:30.299638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2fe812e4d94916933828af10f4a414'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:30.324214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2fe812e4d94916933828af10f4a414'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:30.324994 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2fe812e4d94916933828af10f4a414'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:30.337479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e1bc176b-1d56-4ec7-b9bd-8f938bba58ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2fe812e4d94916933828af10f4a414'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:30.339159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:30.362702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1173/2336] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:29 2022] DELETE /identity/v3/users/ed2fe812e4d94916933828af10f4a414 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:31.310881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:31.313168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:31.353739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd22b21-7958-471d-9892-aa9d2f195b58 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:31.399451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:31.678202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:31.679266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:31.679730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:31.680048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] PATH_INFO: `/v3/projects/75d6c2900b9245aabb2ca257e614ba73` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:31.693628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d6c2900b9245aabb2ca257e614ba73)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:31.695715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:31.988967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d6c2900b9245aabb2ca257e614ba73', 'request_id': 'req-a3a962be-2412-43fe-b237-124e145d7226'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:31.999158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d6c2900b9245aabb2ca257e614ba73', 'request_id': 'req-a3a962be-2412-43fe-b237-124e145d7226'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:32.014428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d6c2900b9245aabb2ca257e614ba73', 'request_id': 'req-a3a962be-2412-43fe-b237-124e145d7226'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:32.143925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] The token cache is being invalidate because project 75d6c2900b9245aabb2ca257e614ba73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:32.143925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:32.144962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a3a962be-2412-43fe-b237-124e145d7226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:32.148395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1164/2337] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:31 2022] DELETE /identity/v3/projects/75d6c2900b9245aabb2ca257e614ba73 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:32.153147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:32.154151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:32.154622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:32.206787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:32.211042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:32.461458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1174/2338] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:32.470511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:32.471134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:32.471519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:32.522661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:32.526400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:32.546762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1165/2339] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:32.554168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:32.585749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ccf0f-f243-4507-9ef5-20e9cd0c7299 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:32.643318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:32.644401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:32.644813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:32.645171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:32.646373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:32.646773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:32.650352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:32.695203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1175/2340] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:06:32.701903 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:32.715723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e377-a508-4d50-83d0-e3fb205a86eb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:32.723334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:32.724555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:32.728080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:32.728080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:32.728080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:32.728968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:32.866250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1166/2341] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:32 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:32.875695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:32.888262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cabc3a-a079-4b49-b6ce-1bd7b7985196 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.006607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.007376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.007864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.008418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.009322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.011549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.231774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1176/2342] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:32 2022] POST /identity/v3/users => generated 282 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:06:33.236397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.249268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13502fad-ba72-40a8-8396-a378f19baf2b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.254516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.255082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.255367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.255805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.256505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.258134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.269109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1167/2343] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:33.273165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.283993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1007e-e9d1-4aea-9d3b-f6e11e01e28e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.289000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.289611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.289900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.290172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.290816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.292470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563205-2d94-4a17-aed1-1cbd825a19e0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.311782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1177/2344] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:33.312804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.332904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b663ba-9297-41bc-a7aa-f3aefd5b7f23 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.346455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.347913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.348443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.349600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] PATH_INFO: `/v3/projects/8eae689781724b1894a82e200e5c312f/users/a54ed65a346f493b932fe26626761c41/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.394682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eae689781724b1894a82e200e5c312f, user_id=a54ed65a346f493b932fe26626761c41, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.398828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.493455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1168/2345] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:33 2022] PUT /identity/v3/projects/8eae689781724b1894a82e200e5c312f/users/a54ed65a346f493b932fe26626761c41/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:33.505178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6340c-91d2-4896-a36c-fc770b6bd498 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.505370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6340c-91d2-4896-a36c-fc770b6bd498 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.505463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6340c-91d2-4896-a36c-fc770b6bd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.550099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d2c6340c-91d2-4896-a36c-fc770b6bd498 None None] MFA Rules not processed for user `a54ed65a346f493b932fe26626761c41`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:33.551406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d2c6340c-91d2-4896-a36c-fc770b6bd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:33.694260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:33.716271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1178/2346] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:33.725503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.728070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:33.865859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:33.880816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d754d-e4bd-4461-9bdc-a12be8c562b6 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.886497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.887462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.888336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.888965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.906029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.910206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.922622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1169/2347] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:36.032373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:36.033289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:36.034344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:36.067244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:36.068801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:36.134226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1179/2348] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:36.150424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:36.152253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:36.232524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383edce-c47d-495c-91e9-6ebe7628ac25 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:36.237963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:36.238668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:36.239079 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:36.239209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:36.250142 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:36.252883 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:36.275219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1170/2349] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:06:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:06:40.936320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.938653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:41.015557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae44fca-59fd-495c-a2bf-c3b1a6b2dbbb None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:41.020368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:41.024720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:41.024720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:41.024720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] PATH_INFO: `/v3/users/07c504cd37184cbfb7cb98e2097b4486` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:41.024720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c504cd37184cbfb7cb98e2097b4486)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:41.025261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:41.268838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c504cd37184cbfb7cb98e2097b4486'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:41.376456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c504cd37184cbfb7cb98e2097b4486'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:41.403231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c504cd37184cbfb7cb98e2097b4486'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:41.404504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c504cd37184cbfb7cb98e2097b4486'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:41.415538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c504cd37184cbfb7cb98e2097b4486'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:41.423241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1180/2350] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:40 2022] DELETE /identity/v3/users/07c504cd37184cbfb7cb98e2097b4486 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:41.787488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:41.798978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fa7c6-1732-4346-a6a8-6669878105f2 service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:41.862047 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:41.862713 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:41.862992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:41.863259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] PATH_INFO: `/v3/projects/e13f147425cf4af0bb2885d337d56382` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:41.864465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13f147425cf4af0bb2885d337d56382)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:41.866403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:42.027046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13f147425cf4af0bb2885d337d56382', 'request_id': 'req-e36a9909-cca3-4d57-8847-b3a316d1d884'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:42.035153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13f147425cf4af0bb2885d337d56382', 'request_id': 'req-e36a9909-cca3-4d57-8847-b3a316d1d884'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:42.041066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13f147425cf4af0bb2885d337d56382', 'request_id': 'req-e36a9909-cca3-4d57-8847-b3a316d1d884'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:42.154444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] The token cache is being invalidate because project e13f147425cf4af0bb2885d337d56382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:42.154737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:42.155380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:42.156901 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1171/2351] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:41 2022] DELETE /identity/v3/projects/e13f147425cf4af0bb2885d337d56382 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:51.418816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:52.150910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:54.800477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:54.802469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:54.975682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededd1f3-d7c9-49a8-8adf-b4a6764a9600 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:55.065644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:55.066295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:55.067056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:55.067056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:55.068649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:55.080870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:55.082476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e4351-885f-4786-8ebf-cf52512d2547 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:55.093253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1181/2352] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:05.088828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=58 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:14.105276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:14.110987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:14.180335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a9909-cca3-4d57-8847-b3a316d1d884 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:14.184327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:14.193130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:14.193130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:14.193130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:14.193130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:14.262321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:14.263782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:14.276855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1172/2353] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:20.793925 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:20.794469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:20.794469 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:20.820481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:20.821161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:20.908080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1182/2354] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:20.932382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:20.933981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:21.022516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bb01e-a487-44b8-9592-f2714e8e4354 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:21.028574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:21.029188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:21.029724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:21.030428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:21.041454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:21.044133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:21.056285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1173/2355] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:07:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:27.500934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:27.503702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:27.599541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8d4ee-b2d9-4842-b32d-73e606f13468 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:27.605030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:27.606002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:27.606534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:27.607019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] PATH_INFO: `/v3/users/21015d13def34d43a3bdae4d859acea2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:27.608347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21015d13def34d43a3bdae4d859acea2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:27.610529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:28.030367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21015d13def34d43a3bdae4d859acea2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.108091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21015d13def34d43a3bdae4d859acea2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.129729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21015d13def34d43a3bdae4d859acea2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.132094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21015d13def34d43a3bdae4d859acea2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.147484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21015d13def34d43a3bdae4d859acea2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.160437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1183/2356] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:27 2022] DELETE /identity/v3/users/21015d13def34d43a3bdae4d859acea2 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:28.500489 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:28.518724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb3ddd-2077-44cc-93f7-aac7ceff0362 service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:28.576300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:28.614056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:28.614981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:28.615266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:28.615542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] PATH_INFO: `/v3/projects/dc7ff6740acd4dd4bd8dd8cf62331c94` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:28.617429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7ff6740acd4dd4bd8dd8cf62331c94)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:28.621397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:28.812146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7ff6740acd4dd4bd8dd8cf62331c94', 'request_id': 'req-1248cbee-2077-46bd-b219-8f39ebeedf0b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.821440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7ff6740acd4dd4bd8dd8cf62331c94', 'request_id': 'req-1248cbee-2077-46bd-b219-8f39ebeedf0b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.831678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7ff6740acd4dd4bd8dd8cf62331c94', 'request_id': 'req-1248cbee-2077-46bd-b219-8f39ebeedf0b'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.937137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] The token cache is being invalidate because project dc7ff6740acd4dd4bd8dd8cf62331c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:28.937683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.939364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:28.941434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1174/2357] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:28 2022] DELETE /identity/v3/projects/dc7ff6740acd4dd4bd8dd8cf62331c94 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:28.945776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:28.947896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:28.968089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba54374-05dd-4e9e-b23f-fb2e9186f789 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:28.996124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:29.055706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:29.056564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:29.056933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:29.057291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] PATH_INFO: `/v3/users/accc1eebd34c498692432189061491ac` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:29.058887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=accc1eebd34c498692432189061491ac)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:29.061149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:29.714666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'accc1eebd34c498692432189061491ac'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:29.878308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'accc1eebd34c498692432189061491ac'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:29.892980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'accc1eebd34c498692432189061491ac'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:29.893772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'accc1eebd34c498692432189061491ac'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:29.901262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-e44bc9cc-587a-43c7-9d13-af5fe2feb193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'accc1eebd34c498692432189061491ac'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:29.909140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1184/2358] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:28 2022] DELETE /identity/v3/users/accc1eebd34c498692432189061491ac => generated 0 bytes in 964 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:30.364667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.366487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.383721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248cbee-2077-46bd-b219-8f39ebeedf0b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:30.505958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:30.506617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.506895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.507185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] PATH_INFO: `/v3/projects/b587a012a31e4c97b12811ea2d139f1e` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.508449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b587a012a31e4c97b12811ea2d139f1e)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:30.511008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:30.689721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b587a012a31e4c97b12811ea2d139f1e', 'request_id': 'req-0e9cce81-de37-4344-a1f8-091fd554083d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.697910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b587a012a31e4c97b12811ea2d139f1e', 'request_id': 'req-0e9cce81-de37-4344-a1f8-091fd554083d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.704103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b587a012a31e4c97b12811ea2d139f1e', 'request_id': 'req-0e9cce81-de37-4344-a1f8-091fd554083d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.780242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:30.787569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] The token cache is being invalidate because project b587a012a31e4c97b12811ea2d139f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:30.789150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.789150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e9cce81-de37-4344-a1f8-091fd554083d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.790189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1175/2359] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:30 2022] DELETE /identity/v3/projects/b587a012a31e4c97b12811ea2d139f1e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:30.795175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.795652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.795734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.821199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:30.823632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.893879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1185/2360] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:30.901923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.902205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.902480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.926919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:30.928095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.939310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1176/2361] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:07:30.940590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.952616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf0a2-bcb3-4724-8b8a-65822833af04 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:30.957428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:30.958083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.958662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.958662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.959261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:07:30.959561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:30.961911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:30.980504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1186/2362] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:07:30.982826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.995455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be229e6-fd48-40ca-87eb-63fced0f7ff2 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.007137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.008523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.008885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.009229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.009965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.012111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.170944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1177/2363] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:31.173309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.201076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257f426-a360-41c3-974c-634927f0d28b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.282816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:31.315720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.316569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.316853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.317446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.319105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.321200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.430142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1187/2364] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:31 2022] POST /identity/v3/users => generated 292 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:31.434023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.446471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368f2-ed91-4e4a-8046-e6b32cc9a2a4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.454487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.455854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.457057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.457547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.458749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.461885 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.486001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1178/2365] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:07:31.505842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.519017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676613ba-96d2-4b5a-8391-a0e6eccd08d0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.524829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.525445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.525708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.525988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.526640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.528787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a24f9-aa53-4cd5-8a67-e3f79315de07 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.541748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1188/2366] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:31.545632 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.564789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123b9d-c498-495b-9d9b-0e4aac951c55 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.579383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.580338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.580806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.581427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] PATH_INFO: `/v3/projects/b645ce584fb2460ca4f965ee617f5a51/users/40c3fbacc95f4199b1784163883e5b2d/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.601213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b645ce584fb2460ca4f965ee617f5a51, user_id=40c3fbacc95f4199b1784163883e5b2d, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.603983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.709689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1179/2367] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:31 2022] PUT /identity/v3/projects/b645ce584fb2460ca4f965ee617f5a51/users/40c3fbacc95f4199b1784163883e5b2d/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:07:31.721455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.721743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.722055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.760026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] MFA Rules not processed for user `40c3fbacc95f4199b1784163883e5b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:31.761654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:31.862985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1189/2368] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:31.867598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.942210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff10b-7da1-4a7d-9b2c-dcdaf3771eaa admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.948143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.948789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.949194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.949476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.950145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.952098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:32.063787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1180/2369] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:31 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:32.064818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:32.079046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2409c3-723e-4593-a089-35c17a1a742b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:32.178347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:32.178999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.179278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.179595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.180318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:32.182324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:32.276274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1190/2370] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:32 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:07:32.277891 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:32.290037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fb530-1c0e-44a2-9af9-89f4e9e38f7f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:32.295183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:32.295616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.301800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.301800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.301800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:32.301800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:32.316141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1181/2371] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:32.317251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:32.333949 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372fc93-a72e-4112-b964-0e3686586c81 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:32.339402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:32.340020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.340337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.340621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.341278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:32.342983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e71bd-4955-48d1-86e5-e2918b77a8a8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:32.375012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1191/2372] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:32.376104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:32.394782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b1c5e-c51a-4af5-8546-48f17646ef36 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:32.402992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:32.404035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.404035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.404273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] PATH_INFO: `/v3/projects/db2203c18ecc451180648cb7fb1b2e02/users/c6880c212369453a9fad5f0334f389d2/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.453742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2203c18ecc451180648cb7fb1b2e02, user_id=c6880c212369453a9fad5f0334f389d2, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:32.456557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:32.570392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.571072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.571570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.577224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1182/2373] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:32 2022] PUT /identity/v3/projects/db2203c18ecc451180648cb7fb1b2e02/users/c6880c212369453a9fad5f0334f389d2/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:32.615986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] MFA Rules not processed for user `c6880c212369453a9fad5f0334f389d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:32.617432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:32.624638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:32.709687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1192/2374] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:32.714437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:32.776531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:32.795218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c730a-db5d-4153-b0d4-e8ba034ed2db admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:32.803646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:32.804357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:32.804641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:32.804918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:32.805590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:32.807621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.083599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1183/2375] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:32 2022] POST /identity/v3/projects => generated 383 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:33.087833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.105159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d040c4-99cf-4db5-be07-ebc24b07be46 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.162192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.162833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.163113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.163387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.164094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:33.166246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.333687 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1193/2376] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:33 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:33.337664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.348470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c60c5-395d-4cad-9325-036976a8833d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.353063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.353668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.353947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.354218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.354863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:33.356603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.367638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1184/2377] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:33.380023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.390549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4444ea8-14b4-4d5e-8a26-836e355d018c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.395968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.397722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.398139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.398422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] PATH_INFO: `/v3/projects/239bcb9507e746a78ea0b1133978877e/users/f60f5d8ee2154c5eb064dc9b82a4aa5d/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.415625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239bcb9507e746a78ea0b1133978877e, user_id=f60f5d8ee2154c5eb064dc9b82a4aa5d, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:33.418371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.512887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1194/2378] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:33 2022] PUT /identity/v3/projects/239bcb9507e746a78ea0b1133978877e/users/f60f5d8ee2154c5eb064dc9b82a4aa5d/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:07:33.517686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.532975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c11d64-0e06-40da-a4a3-ac492fa3505c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.603103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.603724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.604004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.604313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.605627 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:33.606718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f34cc3-a72c-48d2-873c-05310246d001 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.631453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1185/2379] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:33.632617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.654228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e87457-7053-4bd9-80f4-fc999c5453d3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.664637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.665336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.665622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.665894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] PATH_INFO: `/v3/projects/239bcb9507e746a78ea0b1133978877e/users/f60f5d8ee2154c5eb064dc9b82a4aa5d/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.668436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239bcb9507e746a78ea0b1133978877e, user_id=f60f5d8ee2154c5eb064dc9b82a4aa5d, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:33.671090 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:33.694767 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1195/2380] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:33 2022] PUT /identity/v3/projects/239bcb9507e746a78ea0b1133978877e/users/f60f5d8ee2154c5eb064dc9b82a4aa5d/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:33.696100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.696494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.696776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.739591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] MFA Rules not processed for user `f60f5d8ee2154c5eb064dc9b82a4aa5d`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:33.741125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:33.863267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1186/2381] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:07:33.875773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:33.877819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:33.965336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8669dd8-f98b-43e3-a4a0-048fc241eaa3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:33.970338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:33.970968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:33.971251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:33.971581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:33.987474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:34.044027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:34.046460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db2f5f-277e-4849-969e-5ef9b4b0ea57 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:34.058285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1196/2382] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:34.355610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:34.357050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:34.404502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:34.423854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d989fba-0d39-46df-8806-dc339d30471c None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:34.428436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:34.432042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:34.432042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:34.432042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] PATH_INFO: `/v3/users/a54ed65a346f493b932fe26626761c41` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:34.432042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a54ed65a346f493b932fe26626761c41)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:34.432702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:34.686897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a54ed65a346f493b932fe26626761c41'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:34.704312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a54ed65a346f493b932fe26626761c41'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:34.705201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a54ed65a346f493b932fe26626761c41'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:34.712588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a54ed65a346f493b932fe26626761c41'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:34.843776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a54ed65a346f493b932fe26626761c41'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:34.869222 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1187/2383] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:34 2022] DELETE /identity/v3/users/a54ed65a346f493b932fe26626761c41 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:34.873841 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:34.874334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:34.874535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:34.902383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:34.904664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:34.997797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1197/2384] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:35.008645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:35.011625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:35.075766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66a53-0f8f-4dc4-a9b9-c34e6174d346 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:35.080526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:35.081240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.081558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.081869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.092855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:35.094868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bef65c-a122-4e8b-805a-59b30aeaec2c service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:35.105844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1188/2385] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:35.508436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:35.509977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:35.524592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc2dd-4075-4a70-874c-7e664b0b2b84 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:35.529300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:35.529950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.530232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.530505 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] PATH_INFO: `/v3/projects/8eae689781724b1894a82e200e5c312f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.532295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eae689781724b1894a82e200e5c312f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:35.534380 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:35.649737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eae689781724b1894a82e200e5c312f', 'request_id': 'req-b193c20e-71c0-4dd4-889b-c28e6382e27a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:35.720844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eae689781724b1894a82e200e5c312f', 'request_id': 'req-b193c20e-71c0-4dd4-889b-c28e6382e27a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:35.727410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eae689781724b1894a82e200e5c312f', 'request_id': 'req-b193c20e-71c0-4dd4-889b-c28e6382e27a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:35.738942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] The token cache is being invalidate because project 8eae689781724b1894a82e200e5c312f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:35.739230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:35.739900 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-b193c20e-71c0-4dd4-889b-c28e6382e27a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:35.741421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1198/2386] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:35 2022] DELETE /identity/v3/projects/8eae689781724b1894a82e200e5c312f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:35.746277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.746812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.746812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.768172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:35.769419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:35.830935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1189/2387] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:35.839116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.839400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.839679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.861984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:35.863187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:35.872863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1199/2388] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:35.883514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:35.890995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:35.895064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9cffc-bf9a-4cae-9283-c43c96d4feb6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:35.899963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:35.900599 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.900877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.901145 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.901834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:07:35.902238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:35.903842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:35.916602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1190/2389] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:07:35.921069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:35.930752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123cb7c9-504e-4d73-b1ec-4b1e24d7673a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:35.935631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:35.936280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:35.936558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:35.936837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:35.937649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:35.939656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.053826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1200/2390] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:35 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:36.058107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:36.068826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a060fb-1632-417f-8ced-61813e502750 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:36.132748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:36.133772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.134114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.134387 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.135023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:36.137156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.230469 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1191/2391] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:36 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:36.235142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:36.248147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52e6fa-467b-49ff-903c-adc9a59bf3de admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:36.253842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:36.254467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.254745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.255597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.255743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:36.257355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.259818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:36.274325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1201/2392] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:36.276163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:36.288646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2a4ea-fc1d-4c36-bf77-f1babf298afd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:36.295691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:36.298443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.298443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.298443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.298443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:36.299315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecfc4e7-a5c4-4342-8415-ff1ce4272bd4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.312692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1192/2393] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:36.317905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:36.336734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5affc-a8e5-4569-a8dd-bd5148b3dee6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:36.344758 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:36.345487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.345808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.346139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] PATH_INFO: `/v3/projects/1c11b6ca799f4d128e917ab7d1c5976b/users/df770b92a4c64c61a999ccd273e08519/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.362471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c11b6ca799f4d128e917ab7d1c5976b, user_id=df770b92a4c64c61a999ccd273e08519, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:36.365285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.449322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1202/2394] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:36 2022] PUT /identity/v3/projects/1c11b6ca799f4d128e917ab7d1c5976b/users/df770b92a4c64c61a999ccd273e08519/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:36.460927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.461327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.461666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.492858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] MFA Rules not processed for user `df770b92a4c64c61a999ccd273e08519`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:36.494200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:36.567679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1193/2395] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:36.578690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:36.580937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:36.643795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04d06d-9b42-4545-9367-3ccd50adc5a3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:36.647614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:36.648156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:36.648471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:36.649086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:36.658681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:36.660559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:36.670991 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1203/2396] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:37.304113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:37.318989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582c8b9-2657-4e41-a94b-14ed78712d10 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:37.320465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:37.321170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:37.321828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:37.322189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:37.324447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:37.399293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:37.400808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812a0d2-1520-447c-9cf4-30d14a8729c7 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:37.405044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:37.411869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1194/2397] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:39.146285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:39.156268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a011da-ced8-4bb6-ba7b-0f04d0b5284b service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:39.163101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:39.163722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:39.164001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:39.164312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:39.166736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:39.234733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:39.236158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e84eed-a3de-4ba6-9bfc-4cf015b8a595 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:39.247975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1204/2398] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:41.762009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.762548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.762548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.763952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1195/2399] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:07:41.770395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b7e-e40c-44a4-903c-1e4f67cf439b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.770904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b7e-e40c-44a4-903c-1e4f67cf439b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.770904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a4b7e-e40c-44a4-903c-1e4f67cf439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.792467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6b2a4b7e-e40c-44a4-903c-1e4f67cf439b None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:41.793576 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6b2a4b7e-e40c-44a4-903c-1e4f67cf439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:41.861845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1205/2400] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:07:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:41.873551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:41.875953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:41.934259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179ceb9-20a1-4fa2-b9f2-0e500019af32 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:41.938475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:41.939068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:41.939350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:41.939621 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:41.950330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:41.951761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ecfc2-9059-4e17-8fef-e520c413d997 service glance] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:41.964909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1196/2401] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:42.176194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.176449 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.176684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.178059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1206/2402] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:42.183706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dfce-b920-45cf-b252-7a5f78cd928f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.183892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dfce-b920-45cf-b252-7a5f78cd928f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.184030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2dfce-b920-45cf-b252-7a5f78cd928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.204576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e2b2dfce-b920-45cf-b252-7a5f78cd928f None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:42.205778 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e2b2dfce-b920-45cf-b252-7a5f78cd928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:42.269856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1197/2403] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:42.282968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:42.284751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:42.292513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:42.302584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db8a7d-02e7-4eaf-bc89-2752f50e6489 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:42.306716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:42.307420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.307726 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.308970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.315632 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:42.317130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf048c-a9af-4b28-ba42-44ed1b039764 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:42.325068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1207/2404] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:42.412428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.412720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.413024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.414395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1198/2405] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:07:42.419880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.420171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.420515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.440643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:42.441787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:42.451283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1208/2406] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:42.462288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:42.463979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:42.477780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd06b21-5696-4298-8d0b-eadcc205eea9 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:42.481458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:42.482057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:42.482336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:42.482610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:42.492875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:42.494306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955a7b5-1c8c-4963-970c-61782ad68054 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:42.505576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1199/2407] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:45.103286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:45.104739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:45.173285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad043265-a988-4357-aa36-e40fd399c310 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:45.183600 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:45.184355 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:45.184640 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:45.185207 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] PATH_INFO: `/v3/users/40c3fbacc95f4199b1784163883e5b2d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:45.186138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c3fbacc95f4199b1784163883e5b2d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:45.188750 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:45.347127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c3fbacc95f4199b1784163883e5b2d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:45.419114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c3fbacc95f4199b1784163883e5b2d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:45.435549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c3fbacc95f4199b1784163883e5b2d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:45.436356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c3fbacc95f4199b1784163883e5b2d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:45.457677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c3fbacc95f4199b1784163883e5b2d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:45.464425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1209/2408] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:45 2022] DELETE /identity/v3/users/40c3fbacc95f4199b1784163883e5b2d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:45.469038 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:45.469522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:45.469623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:45.490984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:45.492245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:45.562704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1200/2409] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:45.569627 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:45.572112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:45.640036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f72a7-563c-4c75-8666-9542a837cab6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:45.644535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:45.646054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:45.646054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:45.646054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:45.658123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:45.660169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:45.672065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1210/2410] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:07:46.299262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:46.301135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:46.315799 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f1f23-bf4c-4498-a787-cc1f9b9bf63d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:46.321398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:46.322250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:46.322685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:46.323127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] PATH_INFO: `/v3/projects/b645ce584fb2460ca4f965ee617f5a51` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:46.324481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b645ce584fb2460ca4f965ee617f5a51)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:46.326611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:46.456390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:46.475056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b645ce584fb2460ca4f965ee617f5a51', 'request_id': 'req-3c15aca1-536a-4be2-a4aa-747708efacaa'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.483060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b645ce584fb2460ca4f965ee617f5a51', 'request_id': 'req-3c15aca1-536a-4be2-a4aa-747708efacaa'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.489547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b645ce584fb2460ca4f965ee617f5a51', 'request_id': 'req-3c15aca1-536a-4be2-a4aa-747708efacaa'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.583126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] The token cache is being invalidate because project b645ce584fb2460ca4f965ee617f5a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:46.583126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.583126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-3c15aca1-536a-4be2-a4aa-747708efacaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.583126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1201/2411] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:46 2022] DELETE /identity/v3/projects/b645ce584fb2460ca4f965ee617f5a51 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:46.584061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:46.591028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:46.596785 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382c48-96e3-4c53-8d41-9ca4438b2d5f service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:46.662058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:46.662709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:46.663354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:46.663553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] PATH_INFO: `/v3/users/c6880c212369453a9fad5f0334f389d2` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:46.664654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6880c212369453a9fad5f0334f389d2)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:46.666652 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:46.956670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6880c212369453a9fad5f0334f389d2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:46.995523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:46.995834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:46.996077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:47.019054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:47.020333 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:47.038784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6880c212369453a9fad5f0334f389d2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.058120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6880c212369453a9fad5f0334f389d2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.059374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6880c212369453a9fad5f0334f389d2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.073303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6880c212369453a9fad5f0334f389d2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.084392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1211/2412] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:46 2022] DELETE /identity/v3/users/c6880c212369453a9fad5f0334f389d2 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:47.104483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1202/2413] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:07:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:07:47.117845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:47.119295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:47.216538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec68581-4a0b-4f37-8ea0-240b5dcd1459 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:47.221939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:47.222541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:47.222824 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:47.223096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:47.250336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:47.284748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:47.289538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:47.300431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1212/2414] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:07:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:07:47.558660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:47.572976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:47.619694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a443f28b-fdf9-4df1-9c95-668dfd9af9a6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:47.798409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:47.798973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:47.799255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:47.799529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] PATH_INFO: `/v3/projects/db2203c18ecc451180648cb7fb1b2e02` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:47.808444 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2203c18ecc451180648cb7fb1b2e02)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:47.820135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:47.975483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2203c18ecc451180648cb7fb1b2e02', 'request_id': 'req-6ca6d525-f272-4b87-b492-8d2834edb5a0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.988036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2203c18ecc451180648cb7fb1b2e02', 'request_id': 'req-6ca6d525-f272-4b87-b492-8d2834edb5a0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.994971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2203c18ecc451180648cb7fb1b2e02', 'request_id': 'req-6ca6d525-f272-4b87-b492-8d2834edb5a0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:47.999231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:48.111131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] The token cache is being invalidate because project db2203c18ecc451180648cb7fb1b2e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:48.111533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.112197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.116137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1203/2415] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:47 2022] DELETE /identity/v3/projects/db2203c18ecc451180648cb7fb1b2e02 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:48.120683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:48.146131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16c438-d599-4f3e-a9c7-b19b2c698cc3 service swift] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:48.252147 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:48.253223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:48.253717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:48.254191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] PATH_INFO: `/v3/users/f60f5d8ee2154c5eb064dc9b82a4aa5d` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:48.255693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60f5d8ee2154c5eb064dc9b82a4aa5d)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:48.257787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:48.475378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60f5d8ee2154c5eb064dc9b82a4aa5d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.569725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60f5d8ee2154c5eb064dc9b82a4aa5d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.586060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60f5d8ee2154c5eb064dc9b82a4aa5d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.587162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60f5d8ee2154c5eb064dc9b82a4aa5d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.595088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-65f59d5b-e86c-4b7c-9210-2921cd3c6d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60f5d8ee2154c5eb064dc9b82a4aa5d'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:48.601883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1213/2416] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:48 2022] DELETE /identity/v3/users/f60f5d8ee2154c5eb064dc9b82a4aa5d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:49.099950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:49.101787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:49.141009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6d525-f272-4b87-b492-8d2834edb5a0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:49.211035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:49.211814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.212165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.212551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] PATH_INFO: `/v3/projects/239bcb9507e746a78ea0b1133978877e` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.213812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] RBAC: Authorizing `identity:delete_project(project_id=239bcb9507e746a78ea0b1133978877e)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:49.215818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:49.322640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239bcb9507e746a78ea0b1133978877e', 'request_id': 'req-ec9224da-da46-49d0-b5a3-ceac86ac263d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:49.329310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239bcb9507e746a78ea0b1133978877e', 'request_id': 'req-ec9224da-da46-49d0-b5a3-ceac86ac263d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:49.335771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239bcb9507e746a78ea0b1133978877e', 'request_id': 'req-ec9224da-da46-49d0-b5a3-ceac86ac263d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:49.406930 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] The token cache is being invalidate because project 239bcb9507e746a78ea0b1133978877e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:49.407300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:49.407907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ec9224da-da46-49d0-b5a3-ceac86ac263d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:49.413306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1204/2417] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:49 2022] DELETE /identity/v3/projects/239bcb9507e746a78ea0b1133978877e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:49.415031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.415601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.415699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.439574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:49.440926 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:49.497342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:49.522443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1214/2418] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:49.537685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.538237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.538726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.559982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:49.562367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:49.571299 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1205/2419] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:49.575894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:49.586497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26bbc1-d3db-4e2c-b1b0-98193580f672 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:49.591188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:49.591805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.592782 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.593061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.593718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:07:49.594017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:49.595643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:49.609878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1215/2420] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:07:49.617508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:49.627454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fcaf6-babb-48cd-a5c2-bf92966de067 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:49.632331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:49.632952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.633234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.633630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.634287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:49.636230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:49.751322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1206/2421] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:49 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:07:49.757880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:49.768601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db96fa-7b2f-4a99-ab2e-6b777a65d1e9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:49.849281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:49.849913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:49.850187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:49.850541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:49.851161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:49.853150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:49.979296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1216/2422] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:49 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:49.985344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:49.999763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e06c28-1b3a-4567-989e-383980122312 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:50.005330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:50.006027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.006396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.006741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.007465 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:50.009219 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:50.021235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1207/2423] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:50.025353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:50.037733 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234247d5-3de3-46a2-b9e0-86337e804e44 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:50.042906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:50.043536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.043875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.044097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.044781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:50.046495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2106d-3d3b-4998-9f35-0e21f76d1cd7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:50.058389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1217/2424] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:50.063009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:50.083558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348c83-7b8b-46fc-93a4-b186bd309c81 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:50.097061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:50.097061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.097061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.097061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] PATH_INFO: `/v3/projects/146c57410f8a4165af5ac311cff5d665/users/007c06b57b0b42f38e4aa6707716a359/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.110658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146c57410f8a4165af5ac311cff5d665, user_id=007c06b57b0b42f38e4aa6707716a359, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:50.113637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:50.209279 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1208/2425] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:50 2022] PUT /identity/v3/projects/146c57410f8a4165af5ac311cff5d665/users/007c06b57b0b42f38e4aa6707716a359/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:50.220698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.220993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.221273 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.257734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] MFA Rules not processed for user `007c06b57b0b42f38e4aa6707716a359`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:50.259999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:50.356590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1218/2426] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:50.368267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:50.370129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:50.398604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:50.439159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86d9a-2bcb-4a06-afcb-ea289bb1c319 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:50.444137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:50.444798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:50.445090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:50.445373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:50.463677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:50.465254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6779b4-592c-45d7-81dc-10454ffbd557 service glance] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:50.475224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1209/2427] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:52.455394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:52.457181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:52.516939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:52.554862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf681c5-0054-4308-a9fb-2e6ec4739847 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:52.573786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:52.574430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:52.574740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:52.575004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] PATH_INFO: `/v3/users/df770b92a4c64c61a999ccd273e08519` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:52.576700 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df770b92a4c64c61a999ccd273e08519)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:52.578683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:52.788694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df770b92a4c64c61a999ccd273e08519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:52.898030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df770b92a4c64c61a999ccd273e08519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:52.921568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df770b92a4c64c61a999ccd273e08519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:52.922336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df770b92a4c64c61a999ccd273e08519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:52.930141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df770b92a4c64c61a999ccd273e08519'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:52.940676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1219/2428] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:52 2022] DELETE /identity/v3/users/df770b92a4c64c61a999ccd273e08519 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:52.946338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:52.946877 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:52.947518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:52.996277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:52.996277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:53.076001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1210/2429] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:53.088081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:53.088081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:53.153123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77d7ac-d976-4487-bc80-62060336aef5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:53.159867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:53.160522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:53.160861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:53.163323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:53.177281 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:53.178931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ec433-2fa0-472f-b21e-b8463f538d16 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:53.191093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1220/2430] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:53.693323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:53.695766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:53.711304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a857cd-8fec-42b4-b0f5-93e6fd2a1c44 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:53.716154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:53.716909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:53.717188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:53.717966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] PATH_INFO: `/v3/projects/1c11b6ca799f4d128e917ab7d1c5976b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:53.719237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c11b6ca799f4d128e917ab7d1c5976b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:53.721208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:53.912146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c11b6ca799f4d128e917ab7d1c5976b', 'request_id': 'req-9205298f-b392-4b64-9ff1-e4c9b138e550'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:53.922738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c11b6ca799f4d128e917ab7d1c5976b', 'request_id': 'req-9205298f-b392-4b64-9ff1-e4c9b138e550'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:53.929813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c11b6ca799f4d128e917ab7d1c5976b', 'request_id': 'req-9205298f-b392-4b64-9ff1-e4c9b138e550'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:54.050289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] The token cache is being invalidate because project 1c11b6ca799f4d128e917ab7d1c5976b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:54.050991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:54.051287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:54.052980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1211/2431] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:53 2022] DELETE /identity/v3/projects/1c11b6ca799f4d128e917ab7d1c5976b => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:08:03.185811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:04.046167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:17.323325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:17.323325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:17.323903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:17.343494 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:08:17.344760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:17.399796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1221/2432] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:08:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:08:17.412745 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:17.414215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:17.492555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205298f-b392-4b64-9ff1-e4c9b138e550 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:17.497812 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:17.498424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:17.498701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:17.498973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:17.507419 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:17.509053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e04faf-d3cf-4f1e-a512-fe440063641b service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:17.517531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1212/2433] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:08:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:27.393167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=25 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:27.513988 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=32 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:29.655011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:29.656513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:29.724260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2559d-bbac-4b70-b047-214ed0725172 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:29.728719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:29.729347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:29.729631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:29.730272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] PATH_INFO: `/v3/users/007c06b57b0b42f38e4aa6707716a359` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:29.731041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007c06b57b0b42f38e4aa6707716a359)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:29.733076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:29.957472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007c06b57b0b42f38e4aa6707716a359'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.049161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007c06b57b0b42f38e4aa6707716a359'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.063121 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007c06b57b0b42f38e4aa6707716a359'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.063865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007c06b57b0b42f38e4aa6707716a359'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.071096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007c06b57b0b42f38e4aa6707716a359'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.078236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1222/2434] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:08:29 2022] DELETE /identity/v3/users/007c06b57b0b42f38e4aa6707716a359 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:08:30.082779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:30.083294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:30.083294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:30.102923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:08:30.104149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:30.166060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1213/2435] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:08:30.176070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:30.177556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:30.241241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bf7f6-3a87-4c03-8457-6809e00ae9b6 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:30.244838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:30.246188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:30.246471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:30.246748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:30.255901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:30.257368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:30.267933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1223/2436] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:08:30.790472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:30.791962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:30.804932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c019cd40-8ca7-4667-850e-551d6f50677a None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:30.809838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:30.810478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:30.810753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:30.811024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] PATH_INFO: `/v3/projects/146c57410f8a4165af5ac311cff5d665` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:30.812149 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=146c57410f8a4165af5ac311cff5d665)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:30.814116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:30.960993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146c57410f8a4165af5ac311cff5d665', 'request_id': 'req-449c4b15-2240-414b-9d37-b4c6b650c70a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.970626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146c57410f8a4165af5ac311cff5d665', 'request_id': 'req-449c4b15-2240-414b-9d37-b4c6b650c70a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:30.977384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146c57410f8a4165af5ac311cff5d665', 'request_id': 'req-449c4b15-2240-414b-9d37-b4c6b650c70a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:31.062503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] The token cache is being invalidate because project 146c57410f8a4165af5ac311cff5d665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:08:31.062792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:31.063361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:08:31.065002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1214/2437] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:08:30 2022] DELETE /identity/v3/projects/146c57410f8a4165af5ac311cff5d665 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:08:40.263879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:41.058996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:56.105467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:56.105931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:56.203017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09736a-e391-4d68-a83f-958b57d287f3 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:56.272697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:56.273342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:56.273626 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:56.273901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:56.275644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:56.338480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:56.340654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:56.350251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1224/2438] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:08:56.454404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:56.455912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:56.531648 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c4b15-2240-414b-9d37-b4c6b650c70a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:56.535507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:56.536690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:56.537330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:56.537804 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:56.540445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:56.556386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:56.557846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:56.569924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1215/2439] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:08:58.467897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:58.469714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:58.485605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2ada2-4630-40f9-95d3-8239438b4ecb service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:58.492151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:58.492815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:58.493093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:58.493367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:58.495209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:58.537358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:58.573579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:58.575181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:58.585541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1225/2440] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:08:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:08:58.643421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:08:58.644876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:58.656584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63529709-a1bf-4182-90d1-045b3c589c6e service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:08:58.671454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:08:58.672171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:08:58.672511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:08:58.672820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:08:58.675448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:08:58.690630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:08:58.692094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8ec786-ac13-4b03-a457-072a7d5187be service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:08:58.705098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1216/2441] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:08:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:08.647385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=12 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:08.699198 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=32 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:11.254434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:11.255835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:11.314285 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72224549-edb0-43fc-847a-3069b6cdb7d2 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:11.317821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:11.318425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:11.318702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:11.318978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:11.320741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:11.330969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:11.332427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:11.341088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1226/2442] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:09:21.336813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=26 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:23.888863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:23.889428 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:23.889547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:23.910429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] MFA Rules not processed for user `4d3f02b889cb44969b170a61388ce05c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:23.911727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:23.919556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1217/2443] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:09:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:26.788138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:26.803859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cd86-3ca4-403c-a443-755f95746075 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:26.808768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:26.809610 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:26.809739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:26.809929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:26.811861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:26.876257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:26.877811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:26.888152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1227/2444] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:30.685519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:30.687183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:30.704837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335855d7-fa87-4c01-a1c0-97065c1af6cd None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:30.711640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:30.712577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:30.713036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:30.713481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:30.715530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:30.740652 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:30.746927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a5fd8-6660-4ef7-bc18-434f2e374527 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:30.755247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1218/2445] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:35.517819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:35.530115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3902168-7bc9-4795-b5e5-1356db363d99 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:35.535788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:35.536429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:35.536714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:35.536992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:35.539766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:35.553025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:35.554658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:35.574190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1228/2446] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:40.750571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=9 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:42.987238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:42.988109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:42.988109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.008926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] MFA Rules not processed for user `4a5b8b681436473d9b19f90910a8211c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:09:43.010195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.018626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1219/2447] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:09:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:09:43.334729 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:43.336232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.360683 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f10649-bafa-41df-8c1d-ace9c238389b service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:43.364861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:43.365466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.366239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.366517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.368291 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.378053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:43.379521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:43.388730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1229/2448] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:43.809286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:43.810721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.929692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490976a-b005-478e-9aa2-1065170b5518 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:43.934822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:43.935584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:43.935918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:43.936133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:43.938093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:43.950717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:43.952427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e314a152-c222-49bf-b1e8-baf868ce091c service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:43.962088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1220/2449] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:09:53.384985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=46 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:53.957996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=50 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:56.281834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:09:56.307760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7df5fb-d06d-48da-8e8e-32b476c886ab service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:09:56.312582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:09:56.313202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:09:56.313496 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:09:56.313760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:09:56.315523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:09:56.339378 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:09:56.341025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af203cc-8517-48e4-920e-f63c5cadc2cb service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:09:56.351990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1230/2450] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:10:06.347367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=13 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:40.638227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:40.638807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:40.638807 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:40.663695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] MFA Rules not processed for user `43f50b6d10f94b8aa55dd3f2f6ea971e`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:40.665015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:40.672135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1221/2451] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:50.656762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:58.098077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.098699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.098699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.133581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:10:58.134892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.227867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1231/2452] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:10:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:10:58.384759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:58.386945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:58.491306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1c1d4-82fa-4bc4-b93f-222c20c79908 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:58.500965 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:58.502661 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:58.503155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:58.503636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:58.519852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:58.523027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:58.540393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1222/2453] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:10:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:10:59.985128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:00.012364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6014f9-d36b-4df6-a1bd-2d488de629c7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:00.018713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:00.019428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:00.019775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:00.020377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:00.022408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:00.130274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:00.131734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934a933-710b-4c08-ad4c-e699c4461439 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:00.160420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1232/2454] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:04.384479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:04.396914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31eb92-ad86-4078-adf8-d4baa151b144 service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:04.402192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:04.402853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:04.403135 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:04.403408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:04.405284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:04.417884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:04.419508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5c638-fc91-4d24-bb71-6671cee67ca6 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:04.429890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1223/2455] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:08.724508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd823a5-61f1-4fc3-b2c8-a3513a57dfc9 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:08.725289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd823a5-61f1-4fc3-b2c8-a3513a57dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:08.725289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd823a5-61f1-4fc3-b2c8-a3513a57dfc9 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:08.727134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1233/2456] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:11:08.756033 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:08.756676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:08.756788 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:08.789528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:08.790764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:08.801010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1224/2457] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:11:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:08.813930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd823a5-61f1-4fc3-b2c8-a3513a57dfc9 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:08.826287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd823a5-61f1-4fc3-b2c8-a3513a57dfc9 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:08.831808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:08.832401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:08.832684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:08.832959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:08.842212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:08.843862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:08.854927 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1234/2458] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:08.882660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:08.887138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:08.904422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d1879-2470-473d-a8af-8e4d36c89557 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:08.910717 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:08.911417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:08.911707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:08.912005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] PATH_INFO: `/v3/users/c75ec05a36e54b4e946f4258e65eb1f7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:08.913505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75ec05a36e54b4e946f4258e65eb1f7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:08.917069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:09.177206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75ec05a36e54b4e946f4258e65eb1f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.189475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75ec05a36e54b4e946f4258e65eb1f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.190179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75ec05a36e54b4e946f4258e65eb1f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.197070 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75ec05a36e54b4e946f4258e65eb1f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.269549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75ec05a36e54b4e946f4258e65eb1f7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.277364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1225/2459] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:08 2022] DELETE /identity/v3/users/c75ec05a36e54b4e946f4258e65eb1f7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:09.515696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:09.527155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915b2db-db43-4439-94cb-8a31632cf8e3 service placement] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:09.568039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:09.586852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:09.587480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:09.587760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:09.588036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] PATH_INFO: `/v3/projects/c7171fcc75334d32b0491a00449fff92` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:09.589190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7171fcc75334d32b0491a00449fff92)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:09.591078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:09.738464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7171fcc75334d32b0491a00449fff92', 'request_id': 'req-7584d67f-b67a-4c3a-9084-b956ff77637f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.862751 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7171fcc75334d32b0491a00449fff92', 'request_id': 'req-7584d67f-b67a-4c3a-9084-b956ff77637f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.869225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7171fcc75334d32b0491a00449fff92', 'request_id': 'req-7584d67f-b67a-4c3a-9084-b956ff77637f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.881654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] The token cache is being invalidate because project c7171fcc75334d32b0491a00449fff92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:09.881936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.882597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:09.884686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1235/2460] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:09 2022] DELETE /identity/v3/projects/c7171fcc75334d32b0491a00449fff92 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:09.888857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:09.890277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:09.903966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219e326-189b-49bf-9951-2a8896b2e4ec admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:09.935055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:09.962576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:09.963249 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:09.963531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:09.963805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] PATH_INFO: `/v3/users/041194e4895b4a68ba9a6e5935c783c1` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:09.965134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] RBAC: Authorizing `identity:delete_user(user_id=041194e4895b4a68ba9a6e5935c783c1)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:09.967060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:10.172643 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041194e4895b4a68ba9a6e5935c783c1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.186300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041194e4895b4a68ba9a6e5935c783c1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.187185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041194e4895b4a68ba9a6e5935c783c1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.195415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041194e4895b4a68ba9a6e5935c783c1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.274589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041194e4895b4a68ba9a6e5935c783c1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.281668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1226/2461] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:09 2022] DELETE /identity/v3/users/041194e4895b4a68ba9a6e5935c783c1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:10.550398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:10.552354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:10.567642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d67f-b67a-4c3a-9084-b956ff77637f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:10.632418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:10.633074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:10.633353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:10.633621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] PATH_INFO: `/v3/projects/460ce4c06cf3490699e69e8d883de839` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:10.634771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=460ce4c06cf3490699e69e8d883de839)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:10.636685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:10.741960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460ce4c06cf3490699e69e8d883de839', 'request_id': 'req-04d28781-1732-441d-a1ba-4f8fd7f547ee'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.805884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460ce4c06cf3490699e69e8d883de839', 'request_id': 'req-04d28781-1732-441d-a1ba-4f8fd7f547ee'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.811996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460ce4c06cf3490699e69e8d883de839', 'request_id': 'req-04d28781-1732-441d-a1ba-4f8fd7f547ee'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.821212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:10.825935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] The token cache is being invalidate because project 460ce4c06cf3490699e69e8d883de839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:10.826233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.826894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:10.829854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1236/2462] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:10 2022] DELETE /identity/v3/projects/460ce4c06cf3490699e69e8d883de839 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:13.712683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:13.714077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.781925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2676ad9-4ce9-48d9-a16a-b88d8bdf107d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:13.830220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:13.830834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:13.831127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:13.831403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:13.833119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:13.843394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:13.897446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:13.898881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:13.909692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1227/2463] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:17.534769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:17.537105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:17.550398 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d28781-1732-441d-a1ba-4f8fd7f547ee admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:17.555301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:17.555940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:17.556249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:17.556656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] PATH_INFO: `/v3/users/4d3f02b889cb44969b170a61388ce05c` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:17.557855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3f02b889cb44969b170a61388ce05c)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:17.559791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:17.736299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3f02b889cb44969b170a61388ce05c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.805826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3f02b889cb44969b170a61388ce05c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.819585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3f02b889cb44969b170a61388ce05c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.820323 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3f02b889cb44969b170a61388ce05c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.827988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-12f4981a-9905-4c5e-858c-ff01b98c811d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3f02b889cb44969b170a61388ce05c'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:17.835179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1237/2464] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:17 2022] DELETE /identity/v3/users/4d3f02b889cb44969b170a61388ce05c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:18.104623 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.116977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3ed1-58fc-48cd-850f-daa3fcdb3e6d service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.180004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.180796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.181080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.181353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] PATH_INFO: `/v3/projects/4b3060b6875a41ec84e9e0936e710b28` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.182487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b3060b6875a41ec84e9e0936e710b28)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.184459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.293417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3060b6875a41ec84e9e0936e710b28', 'request_id': 'req-a2c3808e-eaf1-4360-ae84-c0aaf957693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.300096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3060b6875a41ec84e9e0936e710b28', 'request_id': 'req-a2c3808e-eaf1-4360-ae84-c0aaf957693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.310701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3060b6875a41ec84e9e0936e710b28', 'request_id': 'req-a2c3808e-eaf1-4360-ae84-c0aaf957693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.382335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] The token cache is being invalidate because project 4b3060b6875a41ec84e9e0936e710b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:18.382588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.383241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a2c3808e-eaf1-4360-ae84-c0aaf957693e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:18.384873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1228/2465] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:18 2022] DELETE /identity/v3/projects/4b3060b6875a41ec84e9e0936e710b28 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:18.390471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.391325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.391654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.455287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:18.456575 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.521609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1238/2466] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:18.529774 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.530061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.530341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.560966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:18.562204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:18.570753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1229/2467] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:18.575621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.585825 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05324ca7-af8f-44ec-ab29-33d65fbd81be None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.590622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.591245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.591523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.591800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.592539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:18.592844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.595007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.608269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1239/2468] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:18.613379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.622902 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23b214-e572-4dc6-b742-12d2850d3bfb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.628622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.629261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.630794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.630794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.630794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.632423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.732858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:18.740691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1230/2469] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:18.745274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.755801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43412cb9-a857-43b2-a8fe-362b5427a519 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.799924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:18.824759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.825422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.825744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.826065 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.827248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.829109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.937286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1240/2470] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:18 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:18.942304 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.955475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb52f3-78d5-4228-b96e-3ca76ff54468 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.960388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.961016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.961296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.961570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.962230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.963854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:18.975313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1231/2471] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:18.979480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:18.990511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da72f4bf-4248-4f1a-92a3-e4ff1e6def63 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:18.995432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:18.996070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:18.996368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:18.996660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:18.997405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:18.999039 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6fc41-a423-44ac-95b9-b1ecdd43cd72 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.011042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1241/2472] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:19.015601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.027008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b441d33-a64a-48c4-8a5d-56fed2ddeb37 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.032536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.033389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.033969 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.034238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] PATH_INFO: `/v3/projects/621f6a8f7c4f41a88d792b576f47f922/users/4dbf811b72084ec8ad387f5b68f970fc/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.051511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] RBAC: Authorizing `identity:create_grant(project_id=621f6a8f7c4f41a88d792b576f47f922, user_id=4dbf811b72084ec8ad387f5b68f970fc, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.054197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.131175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1232/2473] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:19 2022] PUT /identity/v3/projects/621f6a8f7c4f41a88d792b576f47f922/users/4dbf811b72084ec8ad387f5b68f970fc/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:19.151369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.151854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.152367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.182740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] MFA Rules not processed for user `4dbf811b72084ec8ad387f5b68f970fc`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:19.183955 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:19.258508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1242/2474] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:19.263446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.330154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef770c-46a9-44a5-97a4-bb0230a8508a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.334875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.335495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.335777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.336050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.336732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.338640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.459156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1233/2475] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:19 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:19.464693 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.475908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17069c71-3fa9-4652-a6b4-5ce7ffef9198 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.539472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.539999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.540348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.540736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.541454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.543374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.628448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1243/2476] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:19 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:19.632508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.643006 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505867d-ab4d-4a10-8a87-2c059b0aae21 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.647768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.648480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.648761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.649034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.649849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.651452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.662916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1234/2477] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:19.667131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.677746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb649a7-5ecc-4a9a-b273-bb87499fc4ac admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.682415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.683064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.683344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.683618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] PATH_INFO: `/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c/users/7318279834ec46968219a3e3e72d768f/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.698976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bf4a762b3a47a7adf029e16c9b8a8c, user_id=7318279834ec46968219a3e3e72d768f, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.701768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.765113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1244/2478] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:19 2022] PUT /identity/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c/users/7318279834ec46968219a3e3e72d768f/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:19.769684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.780293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8318afb-5ac6-4e46-b9d4-3a91488e0651 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.837918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.838471 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.838754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.839057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.839701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.841431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c25b11-2835-4999-a003-2c77a9a2091c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.854711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1235/2479] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:19.859131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:19.869568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426add83-92d8-4bac-9bf3-bcd3028d2f3e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:19.874236 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:19.874882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.875166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.875479 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] PATH_INFO: `/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c/users/7318279834ec46968219a3e3e72d768f/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.877441 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bf4a762b3a47a7adf029e16c9b8a8c, user_id=7318279834ec46968219a3e3e72d768f, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:19.880050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:19.885722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:19.891451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1245/2480] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:19 2022] PUT /identity/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c/users/7318279834ec46968219a3e3e72d768f/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:19.901847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:19.902137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:19.902415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:19.930709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] MFA Rules not processed for user `7318279834ec46968219a3e3e72d768f`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:19.931913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:19.956017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:20.000344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1236/2481] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:20.011953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:20.013768 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:20.094211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0b3f-9d24-4c64-a42c-44c8c8bfc905 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:20.097858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:20.098458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:20.098738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:20.099012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:20.108961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:20.110430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:20.120317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1246/2482] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:20.339920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:20.350089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec428b3-4dbe-4dfa-a14d-38408bfbd91f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:20.353880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:20.354500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:20.354780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:20.355052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:20.413116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:20.414553 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed639168-ad39-4c76-8fcc-3bbf472973e8 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:20.424881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1237/2483] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:28.991464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:29.056072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4dcb0-b7b9-46d8-9a6f-038f4b9bbb27 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:29.060781 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:29.061421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:29.061730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:29.061978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] PATH_INFO: `/v3/users/4dbf811b72084ec8ad387f5b68f970fc` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:29.063102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbf811b72084ec8ad387f5b68f970fc)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:29.065057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:29.230650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbf811b72084ec8ad387f5b68f970fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:29.300004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbf811b72084ec8ad387f5b68f970fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:29.314231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbf811b72084ec8ad387f5b68f970fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:29.315122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbf811b72084ec8ad387f5b68f970fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:29.322974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbf811b72084ec8ad387f5b68f970fc'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:29.325396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:29.330212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1247/2484] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:28 2022] DELETE /identity/v3/users/4dbf811b72084ec8ad387f5b68f970fc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:29.335022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:29.335528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:29.335528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:29.355118 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:29.356670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:29.418138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1238/2485] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:29.433125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:29.434561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:29.494851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b1557-5a20-43fe-a48c-4a4795086760 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:29.498548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:29.499154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:29.499455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:29.499725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:29.510045 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:29.511506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:29.522054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1248/2486] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:29.915780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:29.927027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:29.940961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8399b-f37b-46d0-ad51-5e565355bda3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:29.947944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:29.951912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:29.951912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:29.951912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] PATH_INFO: `/v3/projects/621f6a8f7c4f41a88d792b576f47f922` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:29.951912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621f6a8f7c4f41a88d792b576f47f922)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:29.952248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:30.087590 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621f6a8f7c4f41a88d792b576f47f922', 'request_id': 'req-a71a6d81-3ac5-47ba-9745-b884a4a99872'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.094560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621f6a8f7c4f41a88d792b576f47f922', 'request_id': 'req-a71a6d81-3ac5-47ba-9745-b884a4a99872'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.095810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:30.106782 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621f6a8f7c4f41a88d792b576f47f922', 'request_id': 'req-a71a6d81-3ac5-47ba-9745-b884a4a99872'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.198918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] The token cache is being invalidate because project 621f6a8f7c4f41a88d792b576f47f922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:30.199151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.199760 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.201311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1239/2487] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:29 2022] DELETE /identity/v3/projects/621f6a8f7c4f41a88d792b576f47f922 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:30.205367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:30.215310 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a634f-e64e-49cd-9798-88e31aa02cdb service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:30.274061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:30.274696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:30.274974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:30.275247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] PATH_INFO: `/v3/users/7318279834ec46968219a3e3e72d768f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:30.276437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7318279834ec46968219a3e3e72d768f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:30.278433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:30.449798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7318279834ec46968219a3e3e72d768f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.536077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7318279834ec46968219a3e3e72d768f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.550969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7318279834ec46968219a3e3e72d768f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.551799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7318279834ec46968219a3e3e72d768f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.559902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-30c740e7-16bd-49f7-9868-5a41676f9c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7318279834ec46968219a3e3e72d768f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:30.568801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1249/2488] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:30 2022] DELETE /identity/v3/users/7318279834ec46968219a3e3e72d768f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:30.972151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:30.973608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:30.987995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a6d81-3ac5-47ba-9745-b884a4a99872 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.046505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.047134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.047410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.047681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] PATH_INFO: `/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.048798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bf4a762b3a47a7adf029e16c9b8a8c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.050857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.186530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bf4a762b3a47a7adf029e16c9b8a8c', 'request_id': 'req-f329308e-b2de-4bf8-8dd8-ebdf9118651e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:31.193705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bf4a762b3a47a7adf029e16c9b8a8c', 'request_id': 'req-f329308e-b2de-4bf8-8dd8-ebdf9118651e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:31.199816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bf4a762b3a47a7adf029e16c9b8a8c', 'request_id': 'req-f329308e-b2de-4bf8-8dd8-ebdf9118651e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:31.276972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] The token cache is being invalidate because project 47bf4a762b3a47a7adf029e16c9b8a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:31.277266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:31.277902 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f329308e-b2de-4bf8-8dd8-ebdf9118651e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:31.279396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1240/2489] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:30 2022] DELETE /identity/v3/projects/47bf4a762b3a47a7adf029e16c9b8a8c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:31.285717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.286418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.286418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.311730 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:31.313495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:31.331222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:31.373410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1250/2490] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:31.383622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.383962 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.384328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.407871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:31.409109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:31.417050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1241/2491] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:11:31.427439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.430884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d435b-8f9f-4a10-92c2-32f2b4919187 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.435512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.436102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.436431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.436686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.437324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:31.438189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.439842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.451810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1251/2492] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:31.457018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.466646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204cbd8-0d63-4aab-8d78-d207454adb61 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.471476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.475533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.475533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.475533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.475533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.475533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.607854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1242/2493] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:31.612450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.622607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822989c1-152d-470c-a67d-d6c7947698d1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.682827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.683430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.683711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.683987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.684761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.686671 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.781838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1252/2494] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:31 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:31.786048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.796447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725fd4a-61ec-42b2-a7a1-c4b384153825 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.801808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.802305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.802589 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.802867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.803518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.805157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.820300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1243/2495] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:31.821644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.832339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e835dd-0210-4104-86bb-5c1def2739b1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.837079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.837685 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.837964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.838272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.838893 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.840573 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727ba23-e85b-404c-94ef-5349eeab714d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.851734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1253/2496] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:31.856502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:31.867977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb8aec-68d1-4387-a3fb-f5cabfb5d132 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:31.872736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:31.873391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.873671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.873942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] PATH_INFO: `/v3/projects/76c2cdf3ee764d0184cdf58c8138e259/users/8fb2b82485ee4395a1b09ff50faac0a5/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.889480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c2cdf3ee764d0184cdf58c8138e259, user_id=8fb2b82485ee4395a1b09ff50faac0a5, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:31.892286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:31.947958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1244/2497] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:31 2022] PUT /identity/v3/projects/76c2cdf3ee764d0184cdf58c8138e259/users/8fb2b82485ee4395a1b09ff50faac0a5/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:31.958455 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:31.958745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:31.959025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:31.987784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] MFA Rules not processed for user `8fb2b82485ee4395a1b09ff50faac0a5`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:31.989078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:32.055421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1254/2498] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:32.060111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.070050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:32.123223 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e953a-135e-46c5-b34c-942dc26c289a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.128017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.128771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.129268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.129545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.130201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.132510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.228436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1245/2499] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:32 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:32.232915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.244502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c06ce-f912-4b23-9747-e052991f787b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.257448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:32.302892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.303631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.303764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.304040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.304710 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.306659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.386204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1255/2500] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:32 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:32.390178 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.401077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e855ea7-da61-43c5-b6a2-25e52e15d461 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.405775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.407152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.407507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.407791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.408476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.410096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.420945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1246/2501] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:32.425302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.435325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0b5d6-5d6c-46f7-b92e-962cb4cd43f5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.440012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.440692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.440973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.441248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] PATH_INFO: `/v3/projects/41502060e94742f59e5fe2b5e8167a44/users/f108839a64484609a6ee4bde19857c20/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.456538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41502060e94742f59e5fe2b5e8167a44, user_id=f108839a64484609a6ee4bde19857c20, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.459182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.523179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1256/2502] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:32 2022] PUT /identity/v3/projects/41502060e94742f59e5fe2b5e8167a44/users/f108839a64484609a6ee4bde19857c20/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:32.527218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.537916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2c7a-6b5f-4e5d-8602-70316216c1bc admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.595272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.595886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.596241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.596478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.597121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.598750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d76cf4-fe74-47b6-bbf4-e243c726d3d4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.609010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1247/2503] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:32.613524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.624026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b5cdf-2397-44f6-ae64-e0b2c4e1c3bb admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.628778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.630853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.630853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.630853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] PATH_INFO: `/v3/projects/41502060e94742f59e5fe2b5e8167a44/users/f108839a64484609a6ee4bde19857c20/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.631891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41502060e94742f59e5fe2b5e8167a44, user_id=f108839a64484609a6ee4bde19857c20, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.634560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.645636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1257/2504] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:32 2022] PUT /identity/v3/projects/41502060e94742f59e5fe2b5e8167a44/users/f108839a64484609a6ee4bde19857c20/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:32.656124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.657004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.657253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.684790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] MFA Rules not processed for user `f108839a64484609a6ee4bde19857c20`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:32.686007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:32.754334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1248/2505] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:32.766590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:32.768340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:32.829666 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcadb4-fdd8-4976-bf2b-4f73459a2b00 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:32.833438 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:32.834046 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:32.834327 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:32.834601 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:32.844073 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:32.845525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:32.855317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1258/2506] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:33.127716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:33.133472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:33.138134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b55e2-3cd4-41fe-b044-1cdec279a870 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:33.142310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:33.142907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:33.143186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:33.143454 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:33.204432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:33.205860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231bc07-6cb2-483b-896e-a627915935dc service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:33.215093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1249/2507] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:42.705923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:42.773060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb44941-b228-4123-86b7-f7b95bb998f4 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:42.777826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:42.778476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:42.778755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:42.779132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] PATH_INFO: `/v3/users/8fb2b82485ee4395a1b09ff50faac0a5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:42.780243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb2b82485ee4395a1b09ff50faac0a5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:42.782226 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:42.797737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:43.019139 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb2b82485ee4395a1b09ff50faac0a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.110855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb2b82485ee4395a1b09ff50faac0a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.127313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb2b82485ee4395a1b09ff50faac0a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.128743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb2b82485ee4395a1b09ff50faac0a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.137265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb2b82485ee4395a1b09ff50faac0a5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.143708 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1259/2508] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:42 2022] DELETE /identity/v3/users/8fb2b82485ee4395a1b09ff50faac0a5 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:43.148095 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:43.148637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:43.148738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:43.168620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:43.169984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:43.229944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1250/2509] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:43.240944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:43.242388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:43.303133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635fc21-25c9-4960-a2ec-e426fea4e43f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:43.306711 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:43.307319 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:43.307602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:43.307879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:43.317036 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:43.318456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:43.328668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1260/2510] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:43.809660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:43.810998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:43.824154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfdb2d-39b4-4fcf-a0d3-6552a82cf9d6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:43.829077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:43.829733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:43.830017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:43.830292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] PATH_INFO: `/v3/projects/76c2cdf3ee764d0184cdf58c8138e259` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:43.832011 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c2cdf3ee764d0184cdf58c8138e259)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:43.834076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:43.959397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c2cdf3ee764d0184cdf58c8138e259', 'request_id': 'req-6f28269b-27d5-44bf-81bb-1e2e5f74313f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.966005 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c2cdf3ee764d0184cdf58c8138e259', 'request_id': 'req-6f28269b-27d5-44bf-81bb-1e2e5f74313f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:43.972380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c2cdf3ee764d0184cdf58c8138e259', 'request_id': 'req-6f28269b-27d5-44bf-81bb-1e2e5f74313f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.041470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] The token cache is being invalidate because project 76c2cdf3ee764d0184cdf58c8138e259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:44.041764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.042399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.043909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1251/2511] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:43 2022] DELETE /identity/v3/projects/76c2cdf3ee764d0184cdf58c8138e259 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:44.048246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:44.058727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193392a-5f9a-423f-86a4-3654f418772c service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:44.118050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:44.118698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:44.118980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:44.119259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] PATH_INFO: `/v3/users/f108839a64484609a6ee4bde19857c20` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:44.120430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f108839a64484609a6ee4bde19857c20)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:44.122423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:44.283883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:44.292808 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f108839a64484609a6ee4bde19857c20'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.358020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f108839a64484609a6ee4bde19857c20'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.370409 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f108839a64484609a6ee4bde19857c20'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.371068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f108839a64484609a6ee4bde19857c20'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.380033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-049b5535-4f51-4a3a-98e0-7b061e96da1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f108839a64484609a6ee4bde19857c20'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:44.386654 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1261/2512] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:11:44 2022] DELETE /identity/v3/users/f108839a64484609a6ee4bde19857c20 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:44.816050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:44.817515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:44.834317 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28269b-27d5-44bf-81bb-1e2e5f74313f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:44.882134 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:44.929989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:44.931278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:44.931634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:44.931981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] PATH_INFO: `/v3/projects/41502060e94742f59e5fe2b5e8167a44` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:44.933813 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41502060e94742f59e5fe2b5e8167a44)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:44.936430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.061899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41502060e94742f59e5fe2b5e8167a44', 'request_id': 'req-cae85754-80cc-4630-8100-57fa2cd91a38'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.068999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41502060e94742f59e5fe2b5e8167a44', 'request_id': 'req-cae85754-80cc-4630-8100-57fa2cd91a38'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.074650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41502060e94742f59e5fe2b5e8167a44', 'request_id': 'req-cae85754-80cc-4630-8100-57fa2cd91a38'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.156461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] The token cache is being invalidate because project 41502060e94742f59e5fe2b5e8167a44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:11:45.156704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.157340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cae85754-80cc-4630-8100-57fa2cd91a38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:11:45.158839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1252/2513] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:11:44 2022] DELETE /identity/v3/projects/41502060e94742f59e5fe2b5e8167a44 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:45.164004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.164499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.164616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.185491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:45.186690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:45.246529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1262/2514] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:45.256503 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07070677-a069-474b-9102-3ced7e38f971 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.256796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07070677-a069-474b-9102-3ced7e38f971 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.257060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07070677-a069-474b-9102-3ced7e38f971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.278710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-07070677-a069-474b-9102-3ced7e38f971 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:45.279957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-07070677-a069-474b-9102-3ced7e38f971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:45.288019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1253/2515] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:45.292446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.302971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b60133-24b9-4ccf-8d68-040c4de1c5ef None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.307656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.308289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.308577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.308854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.309495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:11:45.309798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.311382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.324054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1263/2516] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:11:45.328499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07070677-a069-474b-9102-3ced7e38f971 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.337703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07070677-a069-474b-9102-3ced7e38f971 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.342980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.343571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.343848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.344176 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.344916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.346802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.437994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1254/2517] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:45.442162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.452517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249c943-b40a-4d6a-a7e3-ce991fdd31ec admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.517250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.517862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.518145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.518422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.519723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.521680 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.638717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1264/2518] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:45.643269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.654668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66766e58-8ae0-4e0c-b338-7b09a9c51abe admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.659708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.660361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.660640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.660908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.661584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.663205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.673806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1255/2519] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:45.678215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.688794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669f3ce-d155-4d6f-bb74-5c1a836185ce admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.694041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.701425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.701425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.701425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.701425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.701425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95411a2-10d2-4332-bcc7-4457bf8d06a1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.709221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1265/2520] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:45.713593 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:45.725088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a58520-6cc4-4fe6-8d09-0d0e453067aa admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:45.729749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:45.730662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.730936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.731209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] PATH_INFO: `/v3/projects/aaf6a08e26cd40b29cb17cfc9a285483/users/e0e8a9abe56c45ff9e27fe05be95bdce/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.746245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf6a08e26cd40b29cb17cfc9a285483, user_id=e0e8a9abe56c45ff9e27fe05be95bdce, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:45.748943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:45.833544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1256/2521] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:45 2022] PUT /identity/v3/projects/aaf6a08e26cd40b29cb17cfc9a285483/users/e0e8a9abe56c45ff9e27fe05be95bdce/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:45.845403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:45.845714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:45.846063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:45.874795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] MFA Rules not processed for user `e0e8a9abe56c45ff9e27fe05be95bdce`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:45.876052 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:45.884337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:45.942344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1266/2522] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:45.946847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.005278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:46.015550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5032e02-7f92-439c-872f-f6402506ee6d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.022839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.022839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.022839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.022839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.023231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.024791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.154009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1257/2523] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:11:45 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:11:46.159968 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.170774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e630915-cc46-4b9b-9d2f-d76a59a53684 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.230297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.230826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.231110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.231385 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.232027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.233978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.318374 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1267/2524] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:11:46 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:11:46.322447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.333606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47257203-99e4-46be-8b92-a778d0c0e20a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.338260 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.338867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.339151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.339426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.340066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.341701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.351994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1258/2525] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:46.356518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.366641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ae434-41a2-41a0-8bd7-bf561470fe30 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.371221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.371870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.372152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.372476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] PATH_INFO: `/v3/projects/3e7b2192e6194f49a3c129a4d53b9627/users/3182921a47d44ab1b4f5592e4b94de59/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.388442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7b2192e6194f49a3c129a4d53b9627, user_id=3182921a47d44ab1b4f5592e4b94de59, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.391198 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.501330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1268/2526] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:46 2022] PUT /identity/v3/projects/3e7b2192e6194f49a3c129a4d53b9627/users/3182921a47d44ab1b4f5592e4b94de59/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:46.505780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.516103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa2ec6-682c-42dd-8f96-7e1e8bef7de0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.573806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.574407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.574688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.574959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.575597 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.577352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2412a91-f64e-478d-9c59-7ad32eef9f6b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.587620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1259/2527] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:11:46.595278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.602210 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6664b1be-6130-4ef0-a116-8d7a29449b73 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.607035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.607682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.608000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.608311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] PATH_INFO: `/v3/projects/3e7b2192e6194f49a3c129a4d53b9627/users/3182921a47d44ab1b4f5592e4b94de59/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.610205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7b2192e6194f49a3c129a4d53b9627, user_id=3182921a47d44ab1b4f5592e4b94de59, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.613401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.623898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1269/2528] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:11:46 2022] PUT /identity/v3/projects/3e7b2192e6194f49a3c129a4d53b9627/users/3182921a47d44ab1b4f5592e4b94de59/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:11:46.639180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.639472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.639749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.668530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] MFA Rules not processed for user `3182921a47d44ab1b4f5592e4b94de59`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:46.669734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:46.741113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1260/2529] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:11:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:46.757488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:46.759279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:46.817959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7cc1d6-3ced-4ac2-8713-a4ca52b50a3b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:46.821817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:46.822423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:46.822702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:46.822975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:46.835904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:46.880265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:46.881883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38ca05-ae4f-4ece-b378-e44234353a35 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:46.891140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1270/2530] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:51.231257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:51.232739 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:51.244521 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c236b8-6980-4882-aaaf-a6571857aa08 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:51.248127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:51.248748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:51.249030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:51.249305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:51.258062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:51.259473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:51.268752 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1261/2531] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:11:56.906430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=20 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:58.972546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:58.973151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:58.973151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:58.996293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:11:58.997525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:59.070122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1271/2532] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:11:59.252735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:11:59.254170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:11:59.296351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:59.329635 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98ce37-27dc-4db8-a4c5-a809601fca85 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:11:59.334936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:11:59.335554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:11:59.335853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:11:59.336157 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:11:59.345021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:11:59.350450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032e58b-1d2c-424c-a145-f177f81502ba service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:11:59.355424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1262/2533] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:12:09.059845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=28 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:09.414120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:09.431502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=16 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:09.496306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47031c-5eec-444a-9a31-c74bc8403d59 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:09.501214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:09.501912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:09.502194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:09.502475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] PATH_INFO: `/v3/users/e0e8a9abe56c45ff9e27fe05be95bdce` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:09.503835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e8a9abe56c45ff9e27fe05be95bdce)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:09.505831 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:10.682980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e8a9abe56c45ff9e27fe05be95bdce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:10.767936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e8a9abe56c45ff9e27fe05be95bdce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:10.782791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e8a9abe56c45ff9e27fe05be95bdce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:10.783675 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e8a9abe56c45ff9e27fe05be95bdce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:10.791799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e8a9abe56c45ff9e27fe05be95bdce'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:10.798458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1272/2534] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:09 2022] DELETE /identity/v3/users/e0e8a9abe56c45ff9e27fe05be95bdce => generated 0 bytes in 1385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:10.804612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:10.805520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:10.805999 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:10.831859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:10.832856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:10.914214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1263/2535] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:10.926534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:10.928116 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:11.012528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab7857-a319-4629-b96d-237927b64ddc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:11.016678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:11.017633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:11.018106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:11.018588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:11.031764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:11.033383 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:11.045000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1273/2536] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:11.585786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:11.587284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:11.602068 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48448d87-300d-4249-b345-b1a8e4d31d36 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:11.607355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:11.608024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:11.608325 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:11.608649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] PATH_INFO: `/v3/projects/aaf6a08e26cd40b29cb17cfc9a285483` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:11.609755 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf6a08e26cd40b29cb17cfc9a285483)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:11.611681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:11.790353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf6a08e26cd40b29cb17cfc9a285483', 'request_id': 'req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:11.797707 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf6a08e26cd40b29cb17cfc9a285483', 'request_id': 'req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:11.804536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf6a08e26cd40b29cb17cfc9a285483', 'request_id': 'req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:11.911422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] The token cache is being invalidate because project aaf6a08e26cd40b29cb17cfc9a285483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:11.912498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:11.912851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:11.914447 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1264/2537] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:11 2022] DELETE /identity/v3/projects/aaf6a08e26cd40b29cb17cfc9a285483 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:11.918646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:11.929023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6f090-d401-4cbc-9417-e754a4a39058 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:11.950886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:11.995981 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:11.996664 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:11.996947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:11.997225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] PATH_INFO: `/v3/users/3182921a47d44ab1b4f5592e4b94de59` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:11.998443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3182921a47d44ab1b4f5592e4b94de59)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:12.000682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:12.280298 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3182921a47d44ab1b4f5592e4b94de59'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:12.368026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3182921a47d44ab1b4f5592e4b94de59'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:12.382060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3182921a47d44ab1b4f5592e4b94de59'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:12.389087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3182921a47d44ab1b4f5592e4b94de59'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:12.391375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-99c2a6e7-a509-4d36-ac96-a443a3444ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3182921a47d44ab1b4f5592e4b94de59'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:12.398334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1274/2538] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:11 2022] DELETE /identity/v3/users/3182921a47d44ab1b4f5592e4b94de59 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:12.911378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:12.913066 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:12.928743 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f5a1-e5be-4b7d-b4cf-b339ea817626 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:12.990512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:12.991168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:12.991452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:12.991728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] PATH_INFO: `/v3/projects/3e7b2192e6194f49a3c129a4d53b9627` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:12.992916 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7b2192e6194f49a3c129a4d53b9627)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:12.994904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:13.181750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:13.198384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7b2192e6194f49a3c129a4d53b9627', 'request_id': 'req-424e3855-4015-4daa-8709-31847cd60e59'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:13.205691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7b2192e6194f49a3c129a4d53b9627', 'request_id': 'req-424e3855-4015-4daa-8709-31847cd60e59'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:13.212476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7b2192e6194f49a3c129a4d53b9627', 'request_id': 'req-424e3855-4015-4daa-8709-31847cd60e59'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:13.400876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] The token cache is being invalidate because project 3e7b2192e6194f49a3c129a4d53b9627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:13.401174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:13.405977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-424e3855-4015-4daa-8709-31847cd60e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:13.405977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1265/2539] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:12 2022] DELETE /identity/v3/projects/3e7b2192e6194f49a3c129a4d53b9627 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:13.409289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.409760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.409856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.429969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:13.431134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:13.495929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1275/2540] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:13.503810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.504106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.504438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.526269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:13.531978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:13.535191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1266/2541] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:13.539545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:13.550050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8c914-14d2-449c-b553-9c70b4d9d6be None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:13.558051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:13.559747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.560030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.560369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.560996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:13.561300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:13.562911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:13.578300 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1276/2542] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:13.582552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:13.600695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4703-9db4-4ec3-a7a6-31cf95c8a654 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:13.600695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:13.600695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.600695 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.601009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.601009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:13.601919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:13.757101 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1267/2543] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:13 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:13.761608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:13.771727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e75d3-92d2-49fa-a532-c36f76d46400 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:13.798407 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:13.830060 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:13.830672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.830957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.831235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.831870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:13.833902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:13.961656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1277/2544] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:13 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:13.965759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:13.976437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a7d8-333b-4cfc-8077-0a7dc00f6034 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:13.981172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:13.981767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:13.982044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:13.982312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:13.982950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:13.984680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:13.994581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1268/2545] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:14.002066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.012884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bf82f-80de-46c1-9aca-58ddf74e1f9e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.017936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.018774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.019530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.020231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.021608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.023215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f097cb4-cb62-443a-b57c-c614d7ee4638 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.033628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1278/2546] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:14.037973 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.047923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0596-08b5-4d4a-89b9-563bb86747c9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.052663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.053331 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.053618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.053894 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] PATH_INFO: `/v3/projects/6432e6a1b7004ffb81d8adf4c54628e4/users/56719dc7a473464583386c5e41f6ce09/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.070069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6432e6a1b7004ffb81d8adf4c54628e4, user_id=56719dc7a473464583386c5e41f6ce09, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.072775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.160955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1269/2547] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:14 2022] PUT /identity/v3/projects/6432e6a1b7004ffb81d8adf4c54628e4/users/56719dc7a473464583386c5e41f6ce09/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:14.171361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.171655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.171953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.201331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] MFA Rules not processed for user `56719dc7a473464583386c5e41f6ce09`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:14.202577 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:14.272278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1279/2548] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:14.276814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.339730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9274d0-64e1-47a7-8668-5e965a705009 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.344524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.345128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.345406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.345680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.346310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.348230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.437744 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1270/2549] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:14 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:14.441905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.453490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03960bbb-f719-4c38-8157-2f324539e450 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.509853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.510465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.510743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.511017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.511639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.513604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.642206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1280/2550] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:14 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:14.646438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.656696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4da7ea-1728-45b7-a050-aabc9dbf3426 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.661829 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.662453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.662738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.663007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.663672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.665309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.676004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1271/2551] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:14.680905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.691250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431b0b-4d1c-4418-9b85-15c6352f39d7 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.695963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.696665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.696942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.697221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] PATH_INFO: `/v3/projects/08c510696e28438aa29fc2d2ad75f7e9/users/ceb82dd4adec4d779cf463acfd6e5240/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.712397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c510696e28438aa29fc2d2ad75f7e9, user_id=ceb82dd4adec4d779cf463acfd6e5240, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.715070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.803103 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1281/2552] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:14 2022] PUT /identity/v3/projects/08c510696e28438aa29fc2d2ad75f7e9/users/ceb82dd4adec4d779cf463acfd6e5240/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:14.807301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.817472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb4e7c-80fa-4b59-b7ed-5d9cc6a64b3a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.839128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:14.878900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.879380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.879659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.879932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.880611 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.882286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696f199-1592-4fd6-a1d2-0b9d620c358a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.896929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1272/2553] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:14.898164 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:14.904165 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:14.911113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08646f-1a89-45cc-bdcf-f4726a6a1d0f admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:14.917340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:14.917940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.918217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.918492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] PATH_INFO: `/v3/projects/08c510696e28438aa29fc2d2ad75f7e9/users/ceb82dd4adec4d779cf463acfd6e5240/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.920450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c510696e28438aa29fc2d2ad75f7e9, user_id=ceb82dd4adec4d779cf463acfd6e5240, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:14.923346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:14.935238 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1282/2554] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:14 2022] PUT /identity/v3/projects/08c510696e28438aa29fc2d2ad75f7e9/users/ceb82dd4adec4d779cf463acfd6e5240/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:14.946870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:14.947233 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:14.947580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:14.976918 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] MFA Rules not processed for user `ceb82dd4adec4d779cf463acfd6e5240`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:14.978165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.047510 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1273/2555] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:15.059476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:15.061235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.124049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c602819-ad41-45ce-b8dc-0d1d69f29740 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:15.127811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:15.128451 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.128731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.129008 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.139287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:15.140755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538dc0e-c21f-4100-80ee-aaf7260a97e6 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:15.150849 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1283/2556] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:15.179822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:15.243791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9496d-43f2-4d1f-9895-443b2d04a70e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:15.248516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:15.249143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.249437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.249716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] PATH_INFO: `/v3/users/56719dc7a473464583386c5e41f6ce09` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.250860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56719dc7a473464583386c5e41f6ce09)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:15.252876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:15.386796 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea935-126e-423c-9b54-6320280fc491 None None] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.387082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea935-126e-423c-9b54-6320280fc491 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.387359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ea935-126e-423c-9b54-6320280fc491 None None] PATH_INFO: `/` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.388897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1284/2557] 10.222.0.96 () {54 vars in 961 bytes} [Thu Sep 8 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:12:15.393613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.393921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.394199 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.445120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] MFA Rules not processed for user `1a34d9681ab04766a822de8737a227e0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:15.446347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.514209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56719dc7a473464583386c5e41f6ce09'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.515514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:15.520618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1285/2558] 10.222.0.96 () {58 vars in 1058 bytes} [Thu Sep 8 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:15.527945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56719dc7a473464583386c5e41f6ce09'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.528753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56719dc7a473464583386c5e41f6ce09'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.529405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:15.536019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56719dc7a473464583386c5e41f6ce09'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.539590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f28e5b-fd77-4ee4-a3fb-0e91ea5eddf4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:15.544936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:15.545525 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.550346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.550346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.550346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.560996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:15.562814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef1b35-4b33-4f7e-94a5-34335bf4b292 service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:15.575022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1286/2559] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:15.611726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56719dc7a473464583386c5e41f6ce09'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:15.618468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1274/2560] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:15 2022] DELETE /identity/v3/users/56719dc7a473464583386c5e41f6ce09 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:15.623151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.623437 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.623715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.643566 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:15.644737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.685947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:15.707567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1287/2561] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:15.717407 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:15.718899 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:15.777194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b18c5b-731e-4f14-91eb-3d3d2fb29ff9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:15.780862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:15.781463 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:15.781742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:15.782013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:15.791540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:15.793015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:15.803269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1275/2562] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:16.381369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:16.383260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:16.397996 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ba3b2-e745-4f3c-a3b8-c70f3d1c16b5 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:16.403673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:16.404382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:16.404641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:16.404917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] PATH_INFO: `/v3/projects/6432e6a1b7004ffb81d8adf4c54628e4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:16.406057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6432e6a1b7004ffb81d8adf4c54628e4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:16.408223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:16.563876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6432e6a1b7004ffb81d8adf4c54628e4', 'request_id': 'req-ba4f38af-3be8-412c-affd-86b457f764b1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.678622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6432e6a1b7004ffb81d8adf4c54628e4', 'request_id': 'req-ba4f38af-3be8-412c-affd-86b457f764b1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.689507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6432e6a1b7004ffb81d8adf4c54628e4', 'request_id': 'req-ba4f38af-3be8-412c-affd-86b457f764b1'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.704330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] The token cache is being invalidate because project 6432e6a1b7004ffb81d8adf4c54628e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:16.704631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.705313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:16.706876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1288/2563] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:16 2022] DELETE /identity/v3/projects/6432e6a1b7004ffb81d8adf4c54628e4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:16.711620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:16.722294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c9f18-4c65-46bd-991b-592b02bb4aae service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:16.784024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:16.784377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:16.784664 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:16.785013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] PATH_INFO: `/v3/users/ceb82dd4adec4d779cf463acfd6e5240` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:16.786231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb82dd4adec4d779cf463acfd6e5240)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:16.788933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:17.091459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb82dd4adec4d779cf463acfd6e5240'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.106343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb82dd4adec4d779cf463acfd6e5240'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.107109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb82dd4adec4d779cf463acfd6e5240'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.111991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:17.115117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb82dd4adec4d779cf463acfd6e5240'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.218873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ce0d5c93-fa59-47b3-a0c4-8ff0d01a3f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb82dd4adec4d779cf463acfd6e5240'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:17.225413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1276/2564] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:16 2022] DELETE /identity/v3/users/ceb82dd4adec4d779cf463acfd6e5240 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:17.676674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:17.681580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:17.699182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f38af-3be8-412c-affd-86b457f764b1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:17.765344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:17.766027 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:17.766311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:17.766588 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] PATH_INFO: `/v3/projects/08c510696e28438aa29fc2d2ad75f7e9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:17.767712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c510696e28438aa29fc2d2ad75f7e9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:17.769706 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:17.976119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c510696e28438aa29fc2d2ad75f7e9', 'request_id': 'req-218acf04-8d9c-462b-8c72-ae0002f51407'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.120109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c510696e28438aa29fc2d2ad75f7e9', 'request_id': 'req-218acf04-8d9c-462b-8c72-ae0002f51407'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.126653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c510696e28438aa29fc2d2ad75f7e9', 'request_id': 'req-218acf04-8d9c-462b-8c72-ae0002f51407'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.128617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:18.139252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] The token cache is being invalidate because project 08c510696e28438aa29fc2d2ad75f7e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:18.139570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.140284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-218acf04-8d9c-462b-8c72-ae0002f51407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:18.141820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1289/2565] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:17 2022] DELETE /identity/v3/projects/08c510696e28438aa29fc2d2ad75f7e9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:18.147385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.147851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.147946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.168625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:18.169882 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:18.235466 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1277/2566] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:18.243459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.243743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.244020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.390487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:18.391723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:18.400493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1290/2567] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:18.405174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.415197 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8684c1-8832-4e6a-942c-22c9892bd265 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.419895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.420550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.420835 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.421136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.421784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:18.422088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.423780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.435630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1278/2568] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:18.440194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.450328 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fa52e-245d-4a80-8478-4adab1121b7b None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.455114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.455740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.456017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.456324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.456963 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.458894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.574013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1291/2569] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:18 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:18.578492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.590602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e33f20-4cff-4aa3-8d5f-51a24eb450b7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.660191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.660884 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.661099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.661381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.662021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.663948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.739552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1279/2570] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:18 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:18.744698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.755453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a09c34-7e50-4db3-8b53-c9f17e3a29d1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.760902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.761503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.761776 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.762041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.762674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.764334 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.775887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1292/2571] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:18.779984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.790604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf9c37-1596-4164-ba83-3ea8861294b0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.795550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.796155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.796479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.796767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.798023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.799639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6307a0e-a8c6-4df5-ac94-bf0bd598eb3d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.816056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1280/2572] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:18.819923 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:18.830041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52e4ca-868c-43cf-81bf-7862faee8b74 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:18.834806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:18.835453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.835734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.836064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] PATH_INFO: `/v3/projects/ee54400b10624d819cbbdfb2af9fbae6/users/d6ef124354aa4066aa80372a72c617cd/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.851795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee54400b10624d819cbbdfb2af9fbae6, user_id=d6ef124354aa4066aa80372a72c617cd, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:18.854834 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:18.945524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1293/2573] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:18 2022] PUT /identity/v3/projects/ee54400b10624d819cbbdfb2af9fbae6/users/d6ef124354aa4066aa80372a72c617cd/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:12:18.956826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523d2b4-820e-4c4d-8394-4271d9d4b1a2 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:18.957150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523d2b4-820e-4c4d-8394-4271d9d4b1a2 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:18.957445 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523d2b4-820e-4c4d-8394-4271d9d4b1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:18.991400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0523d2b4-820e-4c4d-8394-4271d9d4b1a2 None None] MFA Rules not processed for user `d6ef124354aa4066aa80372a72c617cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:18.992423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0523d2b4-820e-4c4d-8394-4271d9d4b1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.041148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:19.067605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1281/2574] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:19.072241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.142508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf799-54f8-4791-ad02-696a720c6d99 None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.151777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf799-54f8-4791-ad02-696a720c6d99 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.151777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcf799-54f8-4791-ad02-696a720c6d99 None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.151777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1282/2575] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:12:19.151777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.152765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2766e-67c7-4ebe-9e92-527b6c1b7d6d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.152866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.152866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.156744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.157354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.157634 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.157910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.158554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.160463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.194907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:19.196109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.273316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1283/2576] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:19.284890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.286303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.290284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1294/2577] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:19 2022] POST /identity/v3/projects => generated 389 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:19.294965 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.345851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d857b-33cb-486e-9a49-3b6407c964cb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.359396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183c70-d699-4c56-8ef7-0140988846a2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.371766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.371766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.371766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.371766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.372261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.372261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.401888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.402786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.403173 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.403455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.430529 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:19.472958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.474512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.476251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1295/2578] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:19 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:12:19.480415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.487710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1284/2579] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:19.490572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ba7b2-41c1-4ad0-9ffc-6f8fff8d4605 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.495329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.496091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.496394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.501320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.501320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.501320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.501320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:19.512253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1296/2580] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:19.515448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.527239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920be25-ed7f-4229-bb51-8043f24a33be service glance] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.532001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.532709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.533116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.533270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] PATH_INFO: `/v3/projects/a46c5232f969442abde5949a0e591c69/users/8c44a29036b94286b4d4b4f476a43840/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.551137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46c5232f969442abde5949a0e591c69, user_id=8c44a29036b94286b4d4b4f476a43840, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.553927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc061b-9b4e-4998-9cf7-9fe2870ea7ec admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.686498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1285/2581] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:19 2022] PUT /identity/v3/projects/a46c5232f969442abde5949a0e591c69/users/8c44a29036b94286b4d4b4f476a43840/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:19.690591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.702343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e9fcd-a1dc-4acd-ba29-a6cc999ac424 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.717569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901c26-af09-4ed6-abcc-49a96c4e7f8a None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.717856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901c26-af09-4ed6-abcc-49a96c4e7f8a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.718129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f901c26-af09-4ed6-abcc-49a96c4e7f8a None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.719527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1286/2582] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:12:19.724236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.724605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.724791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.746296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] MFA Rules not processed for user `12ecb77c3d0b4b06a94562fe8da25ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:19.747511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.760296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.760912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.761194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.761467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.762112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.763699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.773920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1297/2583] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:19.778891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.789490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fe650-5a4e-465d-98d2-0f829f1e3f05 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.794312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.794959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.795248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.795524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] PATH_INFO: `/v3/projects/a46c5232f969442abde5949a0e591c69/users/8c44a29036b94286b4d4b4f476a43840/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.797520 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46c5232f969442abde5949a0e591c69, user_id=8c44a29036b94286b4d4b4f476a43840, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.800192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e054246-6ae5-4f39-95d7-fcc465a98a11 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.803541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1287/2584] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:19.816653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1298/2585] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:19 2022] PUT /identity/v3/projects/a46c5232f969442abde5949a0e591c69/users/8c44a29036b94286b4d4b4f476a43840/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:19.817085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.818243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.829367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfacf2-8a6f-4cd6-89b9-688ff2419f30 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:19.884097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.884421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.885194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.885350 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:19.885954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.886229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.886552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.894107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:19.895538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8336c21-3a26-4c09-bf6e-3874ac2c9976 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:19.903712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1288/2586] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:12:19.913115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] MFA Rules not processed for user `8c44a29036b94286b4d4b4f476a43840`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:19.914333 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:19.986069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1299/2587] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:19.995484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6aa7-429c-4622-bd2d-250e2180b8bc None None] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:19.995771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6aa7-429c-4622-bd2d-250e2180b8bc None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:19.996053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6aa7-429c-4622-bd2d-250e2180b8bc None None] PATH_INFO: `/` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:19.997403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:19.997545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1289/2588] 10.222.0.96 () {54 vars in 921 bytes} [Thu Sep 8 14:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:12:19.998912 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.002722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.003100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.003458 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.024194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] MFA Rules not processed for user `7a92f1d8d2904002b5f48ff217117039`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:20.025416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.058076 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38b07c-aa4b-49ac-81c2-0c3e6e90e8bc None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.062909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.063602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.063870 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.064148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.066540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:20.075934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.080885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:20.087939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1300/2589] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:20.104598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1290/2590] 10.222.0.96 () {58 vars in 1018 bytes} [Thu Sep 8 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:20.113010 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:20.115801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.127835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98e148-1242-41b8-8a88-59afdec6b939 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.131564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.132221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.132535 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.132875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.140122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:20.144477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.146071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db5762-e0c2-4fb6-991f-43f6f6b869e2 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:20.164835 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1301/2591] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:20.252909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:20.324649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0e41c-6e74-4c76-abb2-52daf021d3d3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.329777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.330502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.330858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.331270 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] PATH_INFO: `/v3/users/d6ef124354aa4066aa80372a72c617cd` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.332956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ef124354aa4066aa80372a72c617cd)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.335673 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:20.565111 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ef124354aa4066aa80372a72c617cd'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.578164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ef124354aa4066aa80372a72c617cd'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.578858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ef124354aa4066aa80372a72c617cd'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.586857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ef124354aa4066aa80372a72c617cd'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.795748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ef124354aa4066aa80372a72c617cd'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:20.802620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1291/2592] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:20 2022] DELETE /identity/v3/users/d6ef124354aa4066aa80372a72c617cd => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:20.807223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.807722 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.807823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.828771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:20.829992 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.897301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1302/2593] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:20.906979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:20.908473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:20.968359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f938b8b-4d10-481d-9fd3-9df7d0cc453f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:20.971925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:20.973339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:20.973339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:20.973339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:20.981675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:20.985875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:20.987305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:20.997480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1292/2594] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:21.438463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.440166 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:21.465481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49392-3bcb-465b-9123-1fe475a92a69 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.471022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.471802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.472150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.472676 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] PATH_INFO: `/v3/projects/ee54400b10624d819cbbdfb2af9fbae6` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.473918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee54400b10624d819cbbdfb2af9fbae6)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:21.476551 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:21.610351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee54400b10624d819cbbdfb2af9fbae6', 'request_id': 'req-fa0cbc67-5a42-426a-bc96-77a18f275378'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.710674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee54400b10624d819cbbdfb2af9fbae6', 'request_id': 'req-fa0cbc67-5a42-426a-bc96-77a18f275378'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.717372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee54400b10624d819cbbdfb2af9fbae6', 'request_id': 'req-fa0cbc67-5a42-426a-bc96-77a18f275378'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.730193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] The token cache is being invalidate because project ee54400b10624d819cbbdfb2af9fbae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:21.730638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.731301 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:21.732915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1303/2595] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:21 2022] DELETE /identity/v3/projects/ee54400b10624d819cbbdfb2af9fbae6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:21.736991 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:21.747008 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320dc2f-066d-45f2-b841-01d6537a296b service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:21.805659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:21.806298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:21.806577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:21.806880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] PATH_INFO: `/v3/users/8c44a29036b94286b4d4b4f476a43840` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:21.807997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c44a29036b94286b4d4b4f476a43840)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:21.810018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:22.097921 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c44a29036b94286b4d4b4f476a43840'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.111522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c44a29036b94286b4d4b4f476a43840'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.112293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c44a29036b94286b4d4b4f476a43840'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.120693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c44a29036b94286b4d4b4f476a43840'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.209859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-6be32a0b-cdeb-42be-857a-0d6b58e32d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c44a29036b94286b4d4b4f476a43840'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:22.216662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1293/2596] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:21 2022] DELETE /identity/v3/users/8c44a29036b94286b4d4b4f476a43840 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:22.835041 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:22.837071 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:22.851667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cbc67-5a42-426a-bc96-77a18f275378 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:22.917214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:22.917914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:22.918253 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:22.918554 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] PATH_INFO: `/v3/projects/a46c5232f969442abde5949a0e591c69` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:22.919812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46c5232f969442abde5949a0e591c69)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:22.921913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:22.944999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:23.053137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46c5232f969442abde5949a0e591c69', 'request_id': 'req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.070977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.071483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.071684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.093616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.094809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.155360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46c5232f969442abde5949a0e591c69', 'request_id': 'req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.158362 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1294/2597] 10.222.0.96 () {58 vars in 1009 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:23.163423 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46c5232f969442abde5949a0e591c69', 'request_id': 'req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.173151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.173151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.176051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] The token cache is being invalidate because project a46c5232f969442abde5949a0e591c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:23.176373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.177051 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-5fe00abf-eb49-4eaa-84a3-326df6cd28c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:23.179018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1304/2598] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:22 2022] DELETE /identity/v3/projects/a46c5232f969442abde5949a0e591c69 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:23.183786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a9be-ee4e-46d3-b8e0-e8315dddbeed None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.184069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a9be-ee4e-46d3-b8e0-e8315dddbeed None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.184402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6a9be-ee4e-46d3-b8e0-e8315dddbeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.196119 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:23.205337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-27a6a9be-ee4e-46d3-b8e0-e8315dddbeed None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.206558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-27a6a9be-ee4e-46d3-b8e0-e8315dddbeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.249924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65444852-aebc-4961-9833-4ec63c6f6ef1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.256880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.257496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.257822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.258109 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.259967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.271608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.273241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.280237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1305/2599] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:23.282440 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1295/2600] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:12:23.284189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.293107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.293107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.307248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:23.308527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:23.316815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1306/2601] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:23.321945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.333421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfd2ad-c87e-4b4b-a360-48e143ac1c1a service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.337853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.338483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.338864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.339036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.339653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:23.339959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.341684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.353474 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1296/2602] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:23.358293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.368789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0f78-5101-43e8-8586-a19ffb1e2dd4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.373598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.374150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.374431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.374703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.375340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.377325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.541497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1307/2603] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:23.545806 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.574622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e5e6e-d0bf-48d0-904f-b7834543cd33 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.682183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.684938 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.685356 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.685696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.689003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.697254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.797794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1297/2604] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:23 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:23.802001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.814762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2a75-7d73-4412-b468-ed027ab25c71 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.841022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.841760 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.841937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.842205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.842879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.844633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.864953 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1308/2605] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:12:23.868689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.884880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9986f-9d5c-475e-990c-235c0af9fcde admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.895798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.897314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.897769 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.898152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.898913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.900696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2964df1-1884-4917-a8f4-27926c9a1d1f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:23.914160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1298/2606] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:23.918899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:23.932444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300f1f2-79bc-447f-ad2b-8ac66fb9d346 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:23.939368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:23.940743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:23.941025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:23.941302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] PATH_INFO: `/v3/projects/275e40c4ff364ccc91611d868166893f/users/0e20bc1b50da4c2db4f61144002bc979/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:23.964905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=275e40c4ff364ccc91611d868166893f, user_id=0e20bc1b50da4c2db4f61144002bc979, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:23.967747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:24.060802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1309/2607] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:23 2022] PUT /identity/v3/projects/275e40c4ff364ccc91611d868166893f/users/0e20bc1b50da4c2db4f61144002bc979/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:24.072849 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:24.075850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:24.075850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:24.105175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] MFA Rules not processed for user `0e20bc1b50da4c2db4f61144002bc979`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:24.107032 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:24.198721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1299/2608] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:24.209603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:24.211290 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:24.263999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:24.276983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494b590-2c65-49cb-afa0-8a88a5c4ba07 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:24.281096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:24.281778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:24.282127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:24.282467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:24.292564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:24.294789 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9eb57-26c4-4eca-b5a6-20db6963e62d service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:24.306028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1310/2609] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:34.195206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:34.359871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:35.870498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:35.933920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36eee6-10da-4a55-a21d-06c44a170fa6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:35.938516 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:35.939147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:35.939430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:35.939706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] PATH_INFO: `/v3/users/0e20bc1b50da4c2db4f61144002bc979` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:35.940844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e20bc1b50da4c2db4f61144002bc979)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:35.943420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.171151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e20bc1b50da4c2db4f61144002bc979'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.183550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e20bc1b50da4c2db4f61144002bc979'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.184336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e20bc1b50da4c2db4f61144002bc979'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.191404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e20bc1b50da4c2db4f61144002bc979'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.287291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e20bc1b50da4c2db4f61144002bc979'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:36.294268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1300/2610] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:12:35 2022] DELETE /identity/v3/users/0e20bc1b50da4c2db4f61144002bc979 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:36.298901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.299361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.299515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.318948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:36.326670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:36.385086 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1311/2611] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:36.395817 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:36.397560 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:36.456420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee59978-76d7-492d-89bd-b971b035e1f9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:36.460615 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:36.461226 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:36.461508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:36.461776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:36.471214 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:36.472683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cdc47-dad4-436d-b102-3c6679d9059f service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:36.482859 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1301/2612] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:37.780028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:37.781655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:37.797616 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e827e-448e-4cb1-aaa9-877c2be9f6ef None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:37.803506 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:37.804183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:37.804491 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:37.804766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] PATH_INFO: `/v3/projects/275e40c4ff364ccc91611d868166893f` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:37.805951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=275e40c4ff364ccc91611d868166893f)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:37.807934 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:37.948371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275e40c4ff364ccc91611d868166893f', 'request_id': 'req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.056620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275e40c4ff364ccc91611d868166893f', 'request_id': 'req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.062931 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275e40c4ff364ccc91611d868166893f', 'request_id': 'req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.075048 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] The token cache is being invalidate because project 275e40c4ff364ccc91611d868166893f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:12:38.075339 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.075986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-19e5f72e-7635-4c29-9d59-94aaa1fcb8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:12:38.077649 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1312/2613] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:12:37 2022] DELETE /identity/v3/projects/275e40c4ff364ccc91611d868166893f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:38.082511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.083676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.083676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.103351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:38.104890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:38.122572 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.166144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1302/2614] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:38.173980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.174268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.174544 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.195074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:38.196453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:38.204388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1313/2615] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:38.209159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.218672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b3f2d-5abe-4580-baba-4f6bffda2e6f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.223943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.224580 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.224863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.225137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.225783 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:12:38.226086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.227676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.242094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1303/2616] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:12:38.246613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.255933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134b6d4-eac7-4b09-92ea-630b24802454 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.260598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.261192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.261471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.261746 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.262372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.264265 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.386436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1314/2617] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:38.390856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.401909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27820c-e75a-43d7-8d33-8338939417bf admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.461566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.462175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.462456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.462727 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.463359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.465437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.624067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1304/2618] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:12:38.628556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.638813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181a2cd-8ea7-4b44-a044-306f95e6ce22 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.643372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.643960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.644260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.644536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.645177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.646745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.656887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1315/2619] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:38.661993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.672077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c46061-0ae9-4665-adf1-7d00ce6f946c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.677426 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.678025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.678302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.678576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.679210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.680847 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857222bc-0bda-4c92-b5e5-640aaea0b285 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.691473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1305/2620] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:12:38.696341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.708720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6fb57-afad-493d-912f-e3fa585e6ebf admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.713364 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.714058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.714552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.715064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] PATH_INFO: `/v3/projects/7924bd9b19704d1c914c6abb8cdb5941/users/dcc0547a756748d59aab763da81de4ca/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.735509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7924bd9b19704d1c914c6abb8cdb5941, user_id=dcc0547a756748d59aab763da81de4ca, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.738196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:38.802428 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1316/2621] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:12:38 2022] PUT /identity/v3/projects/7924bd9b19704d1c914c6abb8cdb5941/users/dcc0547a756748d59aab763da81de4ca/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:12:38.807562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722baf-6f15-480c-8475-5d52a42eda18 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.807992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722baf-6f15-480c-8475-5d52a42eda18 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.808385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13722baf-6f15-480c-8475-5d52a42eda18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.830706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-13722baf-6f15-480c-8475-5d52a42eda18 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:38.833808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-13722baf-6f15-480c-8475-5d52a42eda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:38.899373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1306/2622] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:38.914035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:38.914035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:38.937755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:38.972402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6e6e4-9928-4036-ad30-4f7e0e16c144 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:38.976769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:38.977381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:38.977665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:38.977939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:38.991890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:38.991890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:39.000473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1317/2623] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:40.436569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe1bd-e583-405c-b2ca-659099d9e6ff None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.437143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe1bd-e583-405c-b2ca-659099d9e6ff None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.437286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbe1bd-e583-405c-b2ca-659099d9e6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.467495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4bbbe1bd-e583-405c-b2ca-659099d9e6ff None None] MFA Rules not processed for user `dcc0547a756748d59aab763da81de4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:40.468765 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4bbbe1bd-e583-405c-b2ca-659099d9e6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:40.487838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:40.541069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1307/2624] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:40.553035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:40.558389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:40.614122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62956ab5-2b3d-420f-a1b3-e76447bce53c service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:40.617807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:40.618408 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:40.618689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:40.618966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:40.627589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:40.629032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a05814b-04a5-41ea-815b-54cb45845e45 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:40.637899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1318/2625] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:12:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:12:43.525860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:43.535401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:43.535401 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:43.545659 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] MFA Rules not processed for user `dcc0547a756748d59aab763da81de4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:43.546854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:43.554352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1308/2626] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:12:43.677526 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:43.678029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:43.678125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:43.697552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] MFA Rules not processed for user `340fc101f9434628ba59243d6968163a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:12:43.698817 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:43.758863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1319/2627] 10.222.0.96 () {58 vars in 967 bytes} [Thu Sep 8 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:12:43.773910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:12:43.775427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:12:43.851881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af913a1b-b39f-4ba1-bc49-99deb0e8e0bb None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:12:43.857618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a8553aa120db40e6945fbaecf851c363', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:12:43.858294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:12:43.858574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:12:43.858851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:12:43.868732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:12:43.874605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:12:43.880665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1309/2628] 10.222.0.96 () {60 vars in 1384 bytes} [Thu Sep 8 14:12:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:53.751149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=68 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:53.877076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=54 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:10.873856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:10.875457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:10.887233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6065ab-57b7-4461-99dd-99bbf79460ee None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:10.891715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:10.892359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:10.892637 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:10.892906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:10.894741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:10.906946 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:10.908445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:10.918702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1320/2629] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:14.960809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:14.962261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:14.979815 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c2cfd-accd-4a05-a7b7-93ff2b2d0657 service swift] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:14.981081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:14.981698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:14.981976 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:14.982253 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] PATH_INFO: `/v3/users/43f50b6d10f94b8aa55dd3f2f6ea971e` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:14.983383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f50b6d10f94b8aa55dd3f2f6ea971e)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:14.985340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:15.202927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f50b6d10f94b8aa55dd3f2f6ea971e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.215137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f50b6d10f94b8aa55dd3f2f6ea971e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.215994 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f50b6d10f94b8aa55dd3f2f6ea971e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.224398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f50b6d10f94b8aa55dd3f2f6ea971e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.319336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-82f4df40-49e3-4c64-83ca-bdb9fdf174fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f50b6d10f94b8aa55dd3f2f6ea971e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.326618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1310/2630] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:14 2022] DELETE /identity/v3/users/43f50b6d10f94b8aa55dd3f2f6ea971e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:15.664672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:15.676389 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55750e39-c0b0-4fe5-a0b7-d5fe59a4c394 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:15.735346 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:15.735905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:15.736184 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:15.736515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] PATH_INFO: `/v3/projects/4db492af84924873b701999627f121d9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:15.737679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db492af84924873b701999627f121d9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:15.739568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:15.863694 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db492af84924873b701999627f121d9', 'request_id': 'req-ab9fe7a6-9699-4fed-b995-a31f9906c619'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.959175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db492af84924873b701999627f121d9', 'request_id': 'req-ab9fe7a6-9699-4fed-b995-a31f9906c619'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.965743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db492af84924873b701999627f121d9', 'request_id': 'req-ab9fe7a6-9699-4fed-b995-a31f9906c619'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.978014 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] The token cache is being invalidate because project 4db492af84924873b701999627f121d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:15.978311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.978951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-ab9fe7a6-9699-4fed-b995-a31f9906c619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:15.980476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1321/2631] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:15 2022] DELETE /identity/v3/projects/4db492af84924873b701999627f121d9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:15.985676 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:15.986201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:15.986201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.007044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:16.008291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:16.068500 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1311/2632] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:16.076556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.076933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.077241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.097366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:16.098569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:16.106867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1322/2633] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:16.111114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.120791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056b1f0-ff3f-4718-8089-c941087e0db6 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.125451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.126046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.126328 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.126603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.127751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:13:16.128059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.129735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.141257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1312/2634] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:13:16.147191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.158375 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f231dc-d12f-45a8-8e67-ecebaf3921c3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.163939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.164570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.164852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.165126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.165819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.167696 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.280910 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1323/2635] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:16.285291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.295725 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9183c-d6e6-461e-96ce-7ea3b7182607 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.355376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.356012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.356321 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.356612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.357254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.359209 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.367383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:16.485361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1313/2636] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:13:16 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:13:16.490040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.500270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03728c-3513-4769-a6c1-d94e7a10f699 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.505583 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.506366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.506699 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.507110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.507602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.509224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.520436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1324/2637] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:16.534054 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.535264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7ff82-b650-4505-984a-0fc14e6aa7f0 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.539936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.540588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.540872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.541144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.541785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.543377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fcfd6-ca75-4100-a25c-32a7ba0c0354 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.554850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1314/2638] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:16.559684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.570274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1e2cd-e2b5-4f81-8565-e498e30d2011 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.574738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.575390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.575669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.575939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] PATH_INFO: `/v3/projects/cb4a6cb94894444fb5c305a69b4ee7de/users/96f99030166244599520bbd13161fc06/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.591037 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4a6cb94894444fb5c305a69b4ee7de, user_id=96f99030166244599520bbd13161fc06, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.593714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:16.748124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1325/2639] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:16 2022] PUT /identity/v3/projects/cb4a6cb94894444fb5c305a69b4ee7de/users/96f99030166244599520bbd13161fc06/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:13:16.760086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.760422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.760702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.789204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] MFA Rules not processed for user `96f99030166244599520bbd13161fc06`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:16.790337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:16.857400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1315/2640] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:16.862853 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:16.876528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:16.923336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab8602-f452-441a-a859-12e0fb17ce52 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:16.928565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:16.929168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:16.929446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:16.929718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:16.930360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:16.932251 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.073579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1326/2641] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:16 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:13:17.077784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.088531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a48113-6e51-4984-a2b0-82cc1b82ac13 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.146165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.146780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.147062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.147337 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.147968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.149919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.251168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1316/2642] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:13:17 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:17.255208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.265523 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b532f4-5a50-4fb1-9cde-f9e0a2bbbc03 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.271284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.271883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.272162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.272471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.273106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.274743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.285956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1327/2643] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:13:17.290794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.301960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c517446-f613-4a4f-a5d3-d02454d0fc37 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.306636 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.307293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.307575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.307854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] PATH_INFO: `/v3/projects/d9ad1580b0bd4a3e852c545c01939166/users/6dbf98ecf87a4ab68ae91a87727fe65a/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.322860 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ad1580b0bd4a3e852c545c01939166, user_id=6dbf98ecf87a4ab68ae91a87727fe65a, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.325671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.445019 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1317/2644] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:17 2022] PUT /identity/v3/projects/d9ad1580b0bd4a3e852c545c01939166/users/6dbf98ecf87a4ab68ae91a87727fe65a/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:17.449122 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.459620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37fcca-a8eb-4813-8dc5-795225a1a67c admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.515077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.515681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.515967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.528638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.528638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.528638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadbe7e-f9be-424a-8fca-8e76fcc3d61c admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.529133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1328/2645] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:17.533515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.545261 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510085-01be-40ee-b7d3-05a99e11c409 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.550020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.550678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.550966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.551262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] PATH_INFO: `/v3/projects/d9ad1580b0bd4a3e852c545c01939166/users/6dbf98ecf87a4ab68ae91a87727fe65a/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.553235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ad1580b0bd4a3e852c545c01939166, user_id=6dbf98ecf87a4ab68ae91a87727fe65a, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.555857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.573579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1318/2646] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:17 2022] PUT /identity/v3/projects/d9ad1580b0bd4a3e852c545c01939166/users/6dbf98ecf87a4ab68ae91a87727fe65a/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:17.606967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.607260 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.607542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.636151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] MFA Rules not processed for user `6dbf98ecf87a4ab68ae91a87727fe65a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:17.650511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:17.707030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1329/2647] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:17.718667 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.724833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:17.743546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:17.782375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840978-e0cc-47c9-bb76-0b737ea395bf admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.786147 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.786753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.787059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.787306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.797206 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.798295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e5f6-8769-46f5-83f6-0e94b9ba5511 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:17.807926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1319/2648] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:17.874404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:17.885119 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:17.938596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222efc9c-60ca-4eb1-8d6e-ff2f133fdddd None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:17.943798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:17.944481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:17.944762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:17.945034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] PATH_INFO: `/v3/users/96f99030166244599520bbd13161fc06` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:17.946209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f99030166244599520bbd13161fc06)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:17.948117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:18.247797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f99030166244599520bbd13161fc06'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:18.324977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f99030166244599520bbd13161fc06'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:18.340153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f99030166244599520bbd13161fc06'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:18.340905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f99030166244599520bbd13161fc06'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:18.348784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f99030166244599520bbd13161fc06'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:18.354967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1330/2649] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:17 2022] DELETE /identity/v3/users/96f99030166244599520bbd13161fc06 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:18.359601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:18.360114 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:18.360257 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:18.380681 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:18.381927 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:18.441018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1320/2650] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:13:18.451067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:18.452538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:18.510120 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171e6025-538f-426a-a9fa-f6457fc0fb82 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:18.513842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:18.514572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:18.514860 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:18.515141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:18.524678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:18.526124 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:18.536935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1331/2651] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:18.967074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:18.968526 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:18.984168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b885b-01aa-4b28-b9b6-ddec799f58f1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:18.989568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:18.990340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:18.991185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:18.991479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] PATH_INFO: `/v3/projects/cb4a6cb94894444fb5c305a69b4ee7de` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:18.993004 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4a6cb94894444fb5c305a69b4ee7de)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:18.995104 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:19.148301 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4a6cb94894444fb5c305a69b4ee7de', 'request_id': 'req-cf59d259-cbde-4a49-90db-9aac010ec6ec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.154939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4a6cb94894444fb5c305a69b4ee7de', 'request_id': 'req-cf59d259-cbde-4a49-90db-9aac010ec6ec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.160872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4a6cb94894444fb5c305a69b4ee7de', 'request_id': 'req-cf59d259-cbde-4a49-90db-9aac010ec6ec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.336556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] The token cache is being invalidate because project cb4a6cb94894444fb5c305a69b4ee7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:19.336845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.337482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.338971 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1321/2652] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:18 2022] DELETE /identity/v3/projects/cb4a6cb94894444fb5c305a69b4ee7de => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:19.343075 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:19.353242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebad9c-7928-494b-8571-a056522d27b2 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:19.385425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:19.413950 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:19.414530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:19.414802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:19.415074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] PATH_INFO: `/v3/users/6dbf98ecf87a4ab68ae91a87727fe65a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:19.416177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dbf98ecf87a4ab68ae91a87727fe65a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:19.418091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:19.682995 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dbf98ecf87a4ab68ae91a87727fe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.810352 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dbf98ecf87a4ab68ae91a87727fe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.824556 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dbf98ecf87a4ab68ae91a87727fe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.825215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dbf98ecf87a4ab68ae91a87727fe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.833283 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0288cb51-6143-4a27-9e9f-41f90a05007d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dbf98ecf87a4ab68ae91a87727fe65a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:19.839434 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1332/2653] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:19 2022] DELETE /identity/v3/users/6dbf98ecf87a4ab68ae91a87727fe65a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:20.287246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:20.288805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:20.302167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59d259-cbde-4a49-90db-9aac010ec6ec admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:20.348464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:20.361158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:20.361793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:20.362072 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:20.362381 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] PATH_INFO: `/v3/projects/d9ad1580b0bd4a3e852c545c01939166` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:20.363566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ad1580b0bd4a3e852c545c01939166)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:20.365505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:20.577184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ad1580b0bd4a3e852c545c01939166', 'request_id': 'req-2697d348-50bb-420d-8bd9-ee4519e839a1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:20.584415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ad1580b0bd4a3e852c545c01939166', 'request_id': 'req-2697d348-50bb-420d-8bd9-ee4519e839a1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:20.590316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ad1580b0bd4a3e852c545c01939166', 'request_id': 'req-2697d348-50bb-420d-8bd9-ee4519e839a1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:20.764548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] The token cache is being invalidate because project d9ad1580b0bd4a3e852c545c01939166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:20.764967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:20.765614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-2697d348-50bb-420d-8bd9-ee4519e839a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:20.767094 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1322/2654] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:20 2022] DELETE /identity/v3/projects/d9ad1580b0bd4a3e852c545c01939166 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:20.778296 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:20.778797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:20.778920 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:20.799659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:20.801099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:20.860188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1333/2655] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:20.871097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:20.871097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:20.871097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:20.889022 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:20.890224 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:20.899441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1323/2656] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:20.903851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:20.913878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de41c3-521c-41ed-b1d8-02a733a5b1c6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:20.918589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:20.928309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:20.934891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1334/2657] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:13:20.939525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:20.949649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c70c8-b7a8-4060-b9b9-1df6d5099de4 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:20.955100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:20.955700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:20.955980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:20.956340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:20.956967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:20.958978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.076034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1324/2658] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:20 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:21.080331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.090531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20669e-d80e-4111-a1f8-162097cccbf1 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.124944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:21.149813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.150419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.150698 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.150973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.151727 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.153663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.279875 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1335/2659] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:13:21 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:21.284140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.295245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be150f4e-00a1-446e-bc40-a237f553b486 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.299808 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.301071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.301343 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.301614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.302534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.303848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.314421 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1325/2660] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:21.318836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.328828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e7fc6-c6b0-44e7-9327-a223286f9c2d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.333631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.334212 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.334492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.334771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.335429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.337646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4a1dd-d002-4a03-b1df-06423190b2cb admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.348678 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1336/2661] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:21.354629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.365309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12327e-e4fe-4f4e-933b-8f58399c9e7b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.369780 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.370423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.370705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.370982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] PATH_INFO: `/v3/projects/91a6e3ea3fae4746a7e5f1d990114660/users/d7fb926f7c934cbaa93addb75965b619/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.386647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a6e3ea3fae4746a7e5f1d990114660, user_id=d7fb926f7c934cbaa93addb75965b619, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.389296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.474354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1326/2662] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:21 2022] PUT /identity/v3/projects/91a6e3ea3fae4746a7e5f1d990114660/users/d7fb926f7c934cbaa93addb75965b619/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:21.484852 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.485134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.485406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.513805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] MFA Rules not processed for user `d7fb926f7c934cbaa93addb75965b619`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:21.515019 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:21.584056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1337/2663] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:21.588698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.651329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47ff9-e877-40ad-9149-3a27193a8980 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.655936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.656569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.656852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.657125 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.657768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.660476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.782594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:21.790950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1327/2664] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:21 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:21.794890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:21.806205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96867b9a-9eec-485e-81c0-9e7d5d56b12d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:21.864794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:21.865405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:21.865689 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:21.865967 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:21.866612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:21.868543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:21.988450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1338/2665] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:13:21 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:21.992352 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:22.002989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb785fe7-b6f7-4e2a-9782-a57776b9f658 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:22.008906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:22.009237 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.009524 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.010034 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.010913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:22.012781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:22.024509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1328/2666] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:22.028826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:22.039132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf122e0f-5f9a-459a-8351-216357a9deed admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:22.043682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:22.044366 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.044644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.044915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] PATH_INFO: `/v3/projects/c100a7825a374e32a8632b8a3b96eadf/users/e2fcdca5b1744e47b67ada0b45182e8c/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.059624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c100a7825a374e32a8632b8a3b96eadf, user_id=e2fcdca5b1744e47b67ada0b45182e8c, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:22.062431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:22.141250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1339/2667] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:22 2022] PUT /identity/v3/projects/c100a7825a374e32a8632b8a3b96eadf/users/e2fcdca5b1744e47b67ada0b45182e8c/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:22.146136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:22.156389 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1366f05-b179-4f50-b112-bd472d439bc5 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:22.213185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:22.213800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.214083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.214433 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.215076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:22.216709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a672a-6659-4c62-9045-286cfc247022 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:22.226547 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1329/2668] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:22.231092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:22.241668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7af8e-d1b8-414e-84d3-217eae7cb202 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:22.246250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:22.246902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.247177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.247453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] PATH_INFO: `/v3/projects/c100a7825a374e32a8632b8a3b96eadf/users/e2fcdca5b1744e47b67ada0b45182e8c/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.249399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c100a7825a374e32a8632b8a3b96eadf, user_id=e2fcdca5b1744e47b67ada0b45182e8c, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:22.252021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:22.258242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:22.263466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1340/2669] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:22 2022] PUT /identity/v3/projects/c100a7825a374e32a8632b8a3b96eadf/users/e2fcdca5b1744e47b67ada0b45182e8c/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:22.274415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.274698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.275002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.302842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] MFA Rules not processed for user `e2fcdca5b1744e47b67ada0b45182e8c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:22.304080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:22.374706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1330/2670] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:22.387536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:22.389311 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:22.449064 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326a95-0a01-4e3b-9b06-386a66f7fe5e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:22.452660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:22.453256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:22.453532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:22.453802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:22.462797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:22.464306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:22.473797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1341/2671] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:23.737777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:23.747883 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538962a-be0d-44e7-8daf-9f02b54cb5b0 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:23.752656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fcdca5b1744e47b67ada0b45182e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c100a7825a374e32a8632b8a3b96eadf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:23.753272 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:23.753557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:23.753839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:23.754575 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:13:23.754874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:23.756515 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:23.768277 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1331/2672] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:13:23.772620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:23.781871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61f50e-e28d-4260-afda-b4b6e64c1166 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:23.787058 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fcdca5b1744e47b67ada0b45182e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c100a7825a374e32a8632b8a3b96eadf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:23.787656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:23.787940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:23.788242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:23.788871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:23.790739 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:23.902731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1342/2673] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:23 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:23.906997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:23.918215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bc1e4-6c66-4cb0-a194-327e7910a568 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:23.973854 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:23.981571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fcdca5b1744e47b67ada0b45182e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c100a7825a374e32a8632b8a3b96eadf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:23.982184 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:23.982497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:23.982779 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:23.983422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:13:23.983724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:23.985418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:23.999630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1332/2674] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:13:24.040195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:24.050806 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42645e52-1285-4999-87e8-60dc6bc820b7 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:24.055842 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2fcdca5b1744e47b67ada0b45182e8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c100a7825a374e32a8632b8a3b96eadf', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:24.058961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:24.058961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:24.058961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] PATH_INFO: `/v3/projects/d5930a90728a4a9cb1d166143d25714e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:24.058961 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d5930a90728a4a9cb1d166143d25714e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:24.060633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:24.205759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5930a90728a4a9cb1d166143d25714e', 'request_id': 'req-0af9ed81-e218-4485-976b-27994f29d185'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:24.330376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5930a90728a4a9cb1d166143d25714e', 'request_id': 'req-0af9ed81-e218-4485-976b-27994f29d185'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:24.337797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5930a90728a4a9cb1d166143d25714e', 'request_id': 'req-0af9ed81-e218-4485-976b-27994f29d185'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:24.350391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] The token cache is being invalidate because project d5930a90728a4a9cb1d166143d25714e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:24.350695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:24.351411 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0af9ed81-e218-4485-976b-27994f29d185 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:24.353218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1343/2675] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:24 2022] DELETE /identity/v3/projects/d5930a90728a4a9cb1d166143d25714e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:25.435848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:25.437733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:25.505144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2c0cb-87a3-4624-a643-f0b62ef98769 tempest-VolumeQuotaClassesTest-1233395369 tempest-VolumeQuotaClassesTest-1233395369-project-admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:25.563442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:25.564086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:25.564427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:25.564704 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] PATH_INFO: `/v3/users/d7fb926f7c934cbaa93addb75965b619` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:25.565869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fb926f7c934cbaa93addb75965b619)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:25.567809 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:26.041723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fb926f7c934cbaa93addb75965b619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:26.053687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fb926f7c934cbaa93addb75965b619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:26.054380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fb926f7c934cbaa93addb75965b619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:26.061308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fb926f7c934cbaa93addb75965b619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:26.175830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fb926f7c934cbaa93addb75965b619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:26.183085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1333/2676] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:25 2022] DELETE /identity/v3/users/d7fb926f7c934cbaa93addb75965b619 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:26.187540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:26.188006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:26.188107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:26.209206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:26.210508 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:26.272317 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1344/2677] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:26.282771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:26.285083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:26.306684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:26.348616 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282782ed-ae00-4ba1-8a3d-e172371de354 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:26.352425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:26.353432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:26.353851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:26.354236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:26.364533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:26.365968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:26.375481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1334/2678] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:26.880490 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:26.881924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:26.889391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:26.895478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e967-32b0-434e-adc6-05f065ff31d7 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:26.901598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:26.902250 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:26.902529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:26.902802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] PATH_INFO: `/v3/projects/91a6e3ea3fae4746a7e5f1d990114660` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:26.903972 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a6e3ea3fae4746a7e5f1d990114660)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:26.905980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:27.064239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a6e3ea3fae4746a7e5f1d990114660', 'request_id': 'req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.181672 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a6e3ea3fae4746a7e5f1d990114660', 'request_id': 'req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.189702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a6e3ea3fae4746a7e5f1d990114660', 'request_id': 'req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.201609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] The token cache is being invalidate because project 91a6e3ea3fae4746a7e5f1d990114660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:27.201896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.202553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.204079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1345/2679] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:26 2022] DELETE /identity/v3/projects/91a6e3ea3fae4746a7e5f1d990114660 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:27.208624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:27.227037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb5b65-e8ef-40d9-8b5b-b936ee6f2818 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:27.287555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:27.288088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:27.288417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:27.288685 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] PATH_INFO: `/v3/users/e2fcdca5b1744e47b67ada0b45182e8c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:27.289843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fcdca5b1744e47b67ada0b45182e8c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:27.291754 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:27.608498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fcdca5b1744e47b67ada0b45182e8c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.623805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fcdca5b1744e47b67ada0b45182e8c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.624556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fcdca5b1744e47b67ada0b45182e8c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.632418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fcdca5b1744e47b67ada0b45182e8c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.770282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-96f84102-b331-4a61-b45e-0f16e5a8f5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fcdca5b1744e47b67ada0b45182e8c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:27.776974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1335/2680] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:13:27 2022] DELETE /identity/v3/users/e2fcdca5b1744e47b67ada0b45182e8c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:13:28.332823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:28.334425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:28.348519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fbf8e-25ad-40a2-83e7-255cf6060dfd admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:28.412786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:28.412786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:28.412786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:28.412786 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] PATH_INFO: `/v3/projects/c100a7825a374e32a8632b8a3b96eadf` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:28.413259 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c100a7825a374e32a8632b8a3b96eadf)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:28.414466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:28.537936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c100a7825a374e32a8632b8a3b96eadf', 'request_id': 'req-a36ea1e7-798f-4b65-aaa0-d9974027004a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:28.633195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c100a7825a374e32a8632b8a3b96eadf', 'request_id': 'req-a36ea1e7-798f-4b65-aaa0-d9974027004a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:28.639252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c100a7825a374e32a8632b8a3b96eadf', 'request_id': 'req-a36ea1e7-798f-4b65-aaa0-d9974027004a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:28.651650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] The token cache is being invalidate because project c100a7825a374e32a8632b8a3b96eadf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:13:28.659211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:28.659211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-a36ea1e7-798f-4b65-aaa0-d9974027004a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:13:28.659211 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1346/2681] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:13:28 2022] DELETE /identity/v3/projects/c100a7825a374e32a8632b8a3b96eadf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:28.659823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:28.660312 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:28.660399 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:28.680866 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:28.682086 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:28.715824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:28.742604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1336/2682] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:28.752012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:28.752330 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:28.752609 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:28.772815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:28.774026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:28.782446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1347/2683] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:28.787405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:28.797236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560eee4-fd10-40ff-9eb4-fd0836b4f512 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:28.802696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:28.803308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:28.803577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:28.803851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:28.804533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:13:28.804867 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:28.806546 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:28.818601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1337/2684] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:13:28.823314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:28.832736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24024a2-12fd-4231-8064-8473b18859ca None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:28.837715 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:28.838367 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:28.838647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:28.838924 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:28.839570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:28.841598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:28.847113 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:28.952908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1348/2685] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:13:28 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:28.953963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:28.964693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d40a0a-46de-40ff-910d-447e02c68d96 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.021838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.022449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.022742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.023001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.023646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.025736 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.205313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1338/2686] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:13:28 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:13:29.210162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:29.220821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67153f-9b39-4a81-b46b-dc39572e03e8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.226280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.226882 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.227161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.227690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.228390 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.229971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.240114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1349/2687] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:29.245021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:29.255519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afc676-7ccb-4ed4-a6ba-e280e9379d68 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.260542 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.261122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.261432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.261855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.266052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.266052 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dccc8-36f1-436d-87ae-d97c421fdd55 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.275622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1339/2688] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:13:29.280104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:29.291603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88826309-4521-4dc4-afbb-9f1857ee7414 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.296277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.296979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.297213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.297487 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] PATH_INFO: `/v3/projects/ea6ee9b4ac5844b090139061e933a3c3/users/8f3a6cf9af0a47b38f52c4f3ad423619/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.313341 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6ee9b4ac5844b090139061e933a3c3, user_id=8f3a6cf9af0a47b38f52c4f3ad423619, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.315985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.433332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1350/2689] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:13:29 2022] PUT /identity/v3/projects/ea6ee9b4ac5844b090139061e933a3c3/users/8f3a6cf9af0a47b38f52c4f3ad423619/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:13:29.445579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320170a-bb23-4d8e-9541-72dd039791a9 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.445879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320170a-bb23-4d8e-9541-72dd039791a9 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.446161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320170a-bb23-4d8e-9541-72dd039791a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.483826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-7320170a-bb23-4d8e-9541-72dd039791a9 None None] MFA Rules not processed for user `8f3a6cf9af0a47b38f52c4f3ad423619`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:29.483826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7320170a-bb23-4d8e-9541-72dd039791a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:29.546720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1340/2690] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:29.559061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:29.560939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:29.619177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa86649-68fd-4097-b3bd-da2b42b73bf2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:29.622845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e34df7c6f30645d292e3595b6c56d134', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:29.623443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.623719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.623990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.633542 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:29.635015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:29.644268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1351/2691] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:29.904127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351d94-831d-48b5-911f-3cf1cb84208a None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:29.904686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351d94-831d-48b5-911f-3cf1cb84208a None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:29.904870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351d94-831d-48b5-911f-3cf1cb84208a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:29.926886 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-13351d94-831d-48b5-911f-3cf1cb84208a None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:29.928213 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-13351d94-831d-48b5-911f-3cf1cb84208a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:29.961436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:30.000075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1341/2692] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:30.023231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:30.024752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:30.101613 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48610e0a-3497-4a75-81eb-b0207ed87d06 service glance] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:30.107805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:30.108471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:30.108748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:30.109017 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:30.118811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:30.120324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:30.142475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1352/2693] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:35.195541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd10d-0e6f-4ea0-813d-bad80f8ad9da None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:35.196112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd10d-0e6f-4ea0-813d-bad80f8ad9da None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:35.196112 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfd10d-0e6f-4ea0-813d-bad80f8ad9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:35.216511 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e9dfd10d-0e6f-4ea0-813d-bad80f8ad9da None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:35.217730 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e9dfd10d-0e6f-4ea0-813d-bad80f8ad9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:35.225909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1342/2694] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:35.249570 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:35.254054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:35.267457 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d104a5-7761-4b23-9980-404f912f6263 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:35.273448 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:35.274056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:35.274344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:35.274625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:35.284709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:35.286783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:35.298150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1353/2695] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:41.115192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a9e-d049-4629-82ea-3d72b4e56233 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:41.115787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a9e-d049-4629-82ea-3d72b4e56233 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:41.115787 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74961a9e-d049-4629-82ea-3d72b4e56233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:41.135709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-74961a9e-d049-4629-82ea-3d72b4e56233 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:41.136952 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-74961a9e-d049-4629-82ea-3d72b4e56233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:41.145961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1343/2696] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:41.170898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:41.183716 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bc039-e7e6-443c-9910-1c902b4264e0 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:41.189361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:41.189971 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:41.190252 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:41.190529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:41.199237 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:41.200887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:41.211138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1354/2697] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:45.873920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a698-e9bc-49d8-a244-75f85468a1d1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:45.874439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a698-e9bc-49d8-a244-75f85468a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:45.874539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067a698-e9bc-49d8-a244-75f85468a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:45.895614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-1067a698-e9bc-49d8-a244-75f85468a1d1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:45.896887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1067a698-e9bc-49d8-a244-75f85468a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:45.905205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1344/2698] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:45.931572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:45.943484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a15084-203b-4000-bb62-9a28f7935398 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:45.949028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:45.949621 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:45.949899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:45.950173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:45.958795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:45.960497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:45.965744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:45.971068 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1355/2699] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:52.327895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349de6-5fd4-4698-b30c-c4f7d8b0d08d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:52.328519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349de6-5fd4-4698-b30c-c4f7d8b0d08d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:52.328519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe349de6-5fd4-4698-b30c-c4f7d8b0d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:52.347979 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-fe349de6-5fd4-4698-b30c-c4f7d8b0d08d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:52.349231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-fe349de6-5fd4-4698-b30c-c4f7d8b0d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:52.358042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1345/2700] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:52.383107 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:52.395433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b695-4b60-4bb7-910b-b3abe9f84d4f service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:52.400987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:52.401582 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:52.401859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:52.402132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:52.410636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:52.412245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:52.423713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1356/2701] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:13:56.534340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:56.535358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:56.535647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:56.555698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:13:56.557024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:13:56.565103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1346/2702] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:13:56.589541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:13:56.600899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759cd4a-0dcb-4319-a471-5e3ec3f334b2 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:13:56.606628 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:13:56.607219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:13:56.607499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:13:56.607771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:13:56.615850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:13:56.617443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:13:56.626755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1357/2703] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:00.642857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:00.644675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:00.650456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=28 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:00.706002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656bf5-ff80-4875-aea5-e0d59307e606 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:00.711031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:00.711657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:00.711936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:00.712230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:00.714201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:00.729766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:00.731228 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:00.744358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1347/2704] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:02.757195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:02.758647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:02.822534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0976a-9f53-4f98-ad46-e03ee048dcd2 service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:02.827848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:02.828510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:02.828798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:02.829072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:02.833550 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:02.853067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:02.854655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad85d4-9a6b-4aa4-bb59-eabe42c75bf9 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:02.872223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1358/2705] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:04.489634 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:04.499869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672c112-3fd0-46df-87b5-aa79b8a6d3c1 service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:04.504846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:04.505396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:04.505764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:04.506103 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] PATH_INFO: `/v3/users/8f3a6cf9af0a47b38f52c4f3ad423619` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:04.507354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3a6cf9af0a47b38f52c4f3ad423619)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:04.509342 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:04.878641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3a6cf9af0a47b38f52c4f3ad423619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:04.892329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3a6cf9af0a47b38f52c4f3ad423619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:04.895850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3a6cf9af0a47b38f52c4f3ad423619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:04.901232 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3a6cf9af0a47b38f52c4f3ad423619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:05.009302 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3a6cf9af0a47b38f52c4f3ad423619'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:05.015763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1348/2706] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:14:04 2022] DELETE /identity/v3/users/8f3a6cf9af0a47b38f52c4f3ad423619 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:05.021085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:05.021602 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:05.021713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:05.041513 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:05.042735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:05.100821 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1359/2707] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:05.111318 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:05.112910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:05.175482 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767542cc-56ef-4871-9e75-420603dd868d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:05.180161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:05.180823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:05.181108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:05.181385 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:05.192371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:05.194694 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f2d56-8a51-4d04-930f-08cad388fe0d service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:05.205653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1349/2708] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:05.988471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:05.990152 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:06.004387 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d07dd3-5741-46c4-be40-4d35fbfd7c28 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:06.019536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:06.019536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.019536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.019536 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] PATH_INFO: `/v3/projects/ea6ee9b4ac5844b090139061e933a3c3` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.021088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6ee9b4ac5844b090139061e933a3c3)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:06.021088 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:06.149161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6ee9b4ac5844b090139061e933a3c3', 'request_id': 'req-567c8ae0-f7af-4d2e-968c-49175dfd072f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:06.277907 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6ee9b4ac5844b090139061e933a3c3', 'request_id': 'req-567c8ae0-f7af-4d2e-968c-49175dfd072f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:06.284161 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6ee9b4ac5844b090139061e933a3c3', 'request_id': 'req-567c8ae0-f7af-4d2e-968c-49175dfd072f'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:06.292546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:06.296415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] The token cache is being invalidate because project ea6ee9b4ac5844b090139061e933a3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:14:06.296731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:06.297372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-567c8ae0-f7af-4d2e-968c-49175dfd072f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:06.298902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1360/2709] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:14:05 2022] DELETE /identity/v3/projects/ea6ee9b4ac5844b090139061e933a3c3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:06.305076 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.305602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.305602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.325984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:06.327238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:06.340772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:06.389870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1350/2710] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:06.399471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.399778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.400081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.422682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:06.426519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:06.432234 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1361/2711] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:06.438182 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:06.449057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb53f-e58f-484b-a65a-f2daf372441b None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:06.453723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:06.455093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.455093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.455093 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.455758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:14:06.456067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:06.457746 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:06.471557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1351/2712] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:14:06.476077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:06.485810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53070d-1c30-4d84-bc8f-ce783e4aad1e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:06.490638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:06.491247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.491530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.491803 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.492468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:06.494368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:06.622631 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1362/2713] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:14:06 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:06.631980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:06.642981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99faad7-7259-4121-ac10-c9e6ea26deef admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:06.825939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:06.826486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.826766 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.827040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.827669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:06.829723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:06.958017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1352/2714] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:14:06 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:06.962171 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:06.972347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b4aa7-862f-4536-8a4c-e996ef775309 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:06.977986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:06.978597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:06.978879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:06.979154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:06.979798 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:06.981534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:06.992461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1363/2715] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:14:06.996437 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:07.006733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789c036-4f34-4e66-830d-4ef24f8814ba admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:07.011462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:07.012071 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.012392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.012663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.013303 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:07.014898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dceb0d-e1cb-477c-82ab-b31e1781b82e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:07.025050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1353/2716] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:14:07.029256 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:07.039948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358106a-68ff-43f1-ab46-bd662a48886a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:07.044514 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:07.045153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.045485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.045763 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] PATH_INFO: `/v3/projects/3ab17ebb0f1e425ba0365ac7a00fb6aa/users/f74367e82d13408b9fe0a6ff9671912c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.061430 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ab17ebb0f1e425ba0365ac7a00fb6aa, user_id=f74367e82d13408b9fe0a6ff9671912c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:07.064044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:07.181921 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1364/2717] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:14:07 2022] PUT /identity/v3/projects/3ab17ebb0f1e425ba0365ac7a00fb6aa/users/f74367e82d13408b9fe0a6ff9671912c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:14:07.192414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.192699 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.192972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.221687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] MFA Rules not processed for user `f74367e82d13408b9fe0a6ff9671912c`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:07.222923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:07.289612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1354/2718] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:07.300980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:07.303280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:07.363879 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a3747-1ffa-4705-985e-e1337bb5d2d3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:07.367908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:07.368587 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.368865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.369195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.378077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:07.379558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1a35a-c1ca-47bc-9b7c-4ba4b12dd7f6 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:07.388756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1365/2719] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:07.416487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:07.435839 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:07.484963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf04f6f-2788-4a39-9617-72accebd8548 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:07.490831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:07.494124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.494124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.494124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] PATH_INFO: `/v3/users/f74367e82d13408b9fe0a6ff9671912c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.494124 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f74367e82d13408b9fe0a6ff9671912c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:07.495266 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:07.719449 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f74367e82d13408b9fe0a6ff9671912c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:07.734310 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f74367e82d13408b9fe0a6ff9671912c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:07.735275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f74367e82d13408b9fe0a6ff9671912c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:07.756084 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f74367e82d13408b9fe0a6ff9671912c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:07.837816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f74367e82d13408b9fe0a6ff9671912c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:07.844926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1355/2720] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:14:07 2022] DELETE /identity/v3/users/f74367e82d13408b9fe0a6ff9671912c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:07.849517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:07.853127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:07.853127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:07.872644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:07.873899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:07.940743 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1366/2721] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:07.951686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:07.953179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:08.011522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4258284-f4b2-4698-ad52-708b14eee9e9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:08.016397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:08.016397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:08.016397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:08.016397 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:08.026315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:08.027851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d5f85-3802-46e0-b1e4-61c2c4ca07a1 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:08.037946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1356/2722] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:08.577663 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:08.578555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:08.594957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823bdf-bbcf-451e-bbb7-828278e25a8c None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:08.601766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:08.602704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:08.602984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:08.603324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] PATH_INFO: `/v3/projects/3ab17ebb0f1e425ba0365ac7a00fb6aa` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:08.605009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ab17ebb0f1e425ba0365ac7a00fb6aa)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:08.612887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:08.738231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:08.748966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ab17ebb0f1e425ba0365ac7a00fb6aa', 'request_id': 'req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:08.856765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ab17ebb0f1e425ba0365ac7a00fb6aa', 'request_id': 'req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:08.863721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ab17ebb0f1e425ba0365ac7a00fb6aa', 'request_id': 'req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:08.876225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] The token cache is being invalidate because project 3ab17ebb0f1e425ba0365ac7a00fb6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:14:08.876537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:08.877304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-64c5a4e1-e1a1-4f13-9683-a3eccb97df69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:08.878871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1367/2723] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:14:08 2022] DELETE /identity/v3/projects/3ab17ebb0f1e425ba0365ac7a00fb6aa => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:08.883908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:08.884457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:08.884569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:08.906663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:08.907922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:08.943480 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:08.984761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1357/2724] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:08.985759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:08.986146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:08.986425 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.016581 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:09.017903 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:09.028074 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1368/2725] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:09.032624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.043498 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9453e2-cb63-4a36-8c55-e3f80546bad3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.048759 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.049415 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.049705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.049981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.050649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:14:09.050953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.052798 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.067388 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1358/2726] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:14:09.072527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.083282 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad47ac-0485-465b-88d3-d3a8a3342a44 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.089898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.090532 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.090814 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.091097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.091756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.093766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.205054 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1369/2727] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:14:09 2022] POST /identity/v3/projects => generated 391 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:09.211090 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.221968 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93081e5-f30c-485e-b63e-651303f6be9e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.285544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.286405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.286682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.286974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.287706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.289682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.384923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1359/2728] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:14:09 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:09.386329 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.398094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3fe37-94c6-4888-9f58-c5f2fd07ce60 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.403935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.404762 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.405050 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.405325 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.405976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.407580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.418754 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1370/2729] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:14:09.422889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.433344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a246f-d808-4462-8cbf-8d9f821d1893 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.438106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.438698 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.438978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.439250 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.439889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.441522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09b8ad-4384-43bf-b8cc-fc8f1e3c595b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.452227 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1360/2730] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:14:09.457021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.467811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636246b-aa2f-4bf4-809c-bd9e3b990975 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.472401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.473049 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.473350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.473636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] PATH_INFO: `/v3/projects/bce154a624084b01a17b77e92ebd2e6b/users/b87fdfa376fd4d2899dd7b6bd3fae032/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.491085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bce154a624084b01a17b77e92ebd2e6b, user_id=b87fdfa376fd4d2899dd7b6bd3fae032, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.500509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.621102 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1371/2731] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:14:09 2022] PUT /identity/v3/projects/bce154a624084b01a17b77e92ebd2e6b/users/b87fdfa376fd4d2899dd7b6bd3fae032/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:09.632853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1afc-616d-4292-8a88-02ba7b2e041b None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.633138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1afc-616d-4292-8a88-02ba7b2e041b None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.633413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f1afc-616d-4292-8a88-02ba7b2e041b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.661830 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-f22f1afc-616d-4292-8a88-02ba7b2e041b None None] MFA Rules not processed for user `b87fdfa376fd4d2899dd7b6bd3fae032`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:09.662967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f22f1afc-616d-4292-8a88-02ba7b2e041b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:09.738026 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1361/2732] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:09.751772 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:09.753549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:09.819038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed36675-f165-4d6f-9afc-e16c20e5d850 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:09.822761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:09.823372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:09.823650 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:09.823918 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:09.833030 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:09.834502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:09.844024 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1372/2733] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:17.298898 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:17.299470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:17.299470 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:17.319431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] MFA Rules not processed for user `dcc0547a756748d59aab763da81de4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:17.320666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:17.351913 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:17.378291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1362/2734] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:17.631188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:17.632836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:17.692379 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea86d27-4f1e-4373-8f55-3bb3c95215dc service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:17.696266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:17.696932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:17.697213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:17.697488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:17.699246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:17.710656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:17.712117 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:17.721009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1373/2735] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:17.874442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:17.876106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:17.891315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dfcce-33ea-497a-b3cf-7af3a3a2ef93 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:17.895148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:17.895838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:17.896196 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:17.896612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:17.898827 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:17.977732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:17.979678 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:17.997345 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1363/2736] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:22.062718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:22.069195 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:22.072044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2e3b-0edf-403d-8352-bf9443c6fdef service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:22.075741 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:22.076372 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:22.076653 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:22.076928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:22.078679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:22.088979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:22.090381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:22.098688 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1374/2737] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:22.124970 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:22.126459 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:22.142268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14809f-27b2-47a3-9e69-05987b0cfcdb service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:22.149974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:22.150959 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:22.151895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:22.152314 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] PATH_INFO: `/v3/users/4a5b8b681436473d9b19f90910a8211c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:22.172010 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5b8b681436473d9b19f90910a8211c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:22.173972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:22.406763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5b8b681436473d9b19f90910a8211c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:22.421917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5b8b681436473d9b19f90910a8211c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:22.423544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5b8b681436473d9b19f90910a8211c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:22.431668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5b8b681436473d9b19f90910a8211c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:22.540413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-03e0e4a5-49ce-46bf-99a7-f96589592811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5b8b681436473d9b19f90910a8211c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:22.546974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1364/2738] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:14:22 2022] DELETE /identity/v3/users/4a5b8b681436473d9b19f90910a8211c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:14:22.953656 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:22.966661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce646b-0f49-476a-a610-beca9ea97c2c service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.028538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.029177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.029450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.029757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] PATH_INFO: `/v3/projects/b6a70f0a10cc4d2abd08aac2c52b4217` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.040381 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a70f0a10cc4d2abd08aac2c52b4217)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.042335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.218038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a70f0a10cc4d2abd08aac2c52b4217', 'request_id': 'req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.283005 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a70f0a10cc4d2abd08aac2c52b4217', 'request_id': 'req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.289795 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a70f0a10cc4d2abd08aac2c52b4217', 'request_id': 'req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.303584 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] The token cache is being invalidate because project b6a70f0a10cc4d2abd08aac2c52b4217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:14:23.303890 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.304567 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2389c818-1fd5-4af1-9fe4-23fa42b41fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.306070 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1375/2739] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:14:22 2022] DELETE /identity/v3/projects/b6a70f0a10cc4d2abd08aac2c52b4217 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:23.311029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.311550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.311660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.331925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:23.333981 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:23.364396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:23.395790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1365/2740] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:23.407929 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.408877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.408877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.430084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:23.431307 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:23.439442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1376/2741] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:23.448518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.460987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfbb4-e1d1-4530-b646-35d9867962d1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.466043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.466645 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.466922 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.467189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.467826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:14:23.468175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.469758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.479464 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.480936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:23.485625 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1366/2742] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:14:23.490751 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.495766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed8b2-6013-4a95-8d7e-9f7c4a94d960 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.500620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.501262 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.501405 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6c071-f6f1-4d2f-8a41-be165ecea832 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.501545 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.501827 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] PATH_INFO: `/v3/users/b87fdfa376fd4d2899dd7b6bd3fae032` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.503026 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b87fdfa376fd4d2899dd7b6bd3fae032)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.505022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.506379 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.506985 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.507265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.507887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.508164 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.510074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.650467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1367/2743] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:14:23 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:23.658074 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.724361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288078e-58e8-4fa7-a514-bfd428af2cc9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.729255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.729858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.732355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.732355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.732355 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.732960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.838168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b87fdfa376fd4d2899dd7b6bd3fae032'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.840693 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1368/2744] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:14:23 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:14:23.846027 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.858131 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c01836-bde3-4e0b-a885-3aa46ab1e430 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.863141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.863762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.864540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.864540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.865021 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.866687 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.878353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1369/2745] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:14:23.882155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.892168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30a454-8a36-4680-8283-39e3d8833961 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.897473 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.898172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.898554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.898871 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.899564 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.901264 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.917770 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1370/2746] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:14:23.918833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:23.928960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e9aec-a786-475a-85ea-b064fd1d0148 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:23.933720 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:23.934377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.934653 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.934933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] PATH_INFO: `/v3/projects/42a7f86c5ab44aa5b45475217ea8e806/users/cbe43a17db274c5aa5188afca3f3710c/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.940612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b87fdfa376fd4d2899dd7b6bd3fae032'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.948898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:23.950295 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a7f86c5ab44aa5b45475217ea8e806, user_id=cbe43a17db274c5aa5188afca3f3710c, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:23.953217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c03a7-b6b8-45b4-85cd-37f12cd9d703 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:23.959480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b87fdfa376fd4d2899dd7b6bd3fae032'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.960225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b87fdfa376fd4d2899dd7b6bd3fae032'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.967775 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2b273c14-bf37-4c01-ba02-6ce3c418976e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b87fdfa376fd4d2899dd7b6bd3fae032'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:23.977571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1377/2747] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:14:23 2022] DELETE /identity/v3/users/b87fdfa376fd4d2899dd7b6bd3fae032 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:14:23.979204 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:23.979495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:23.979773 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:23.999082 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:24.000507 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:24.060435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1378/2748] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:14:24.070314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:24.071670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:24.115338 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1371/2749] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:14:23 2022] PUT /identity/v3/projects/42a7f86c5ab44aa5b45475217ea8e806/users/cbe43a17db274c5aa5188afca3f3710c/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:24.120416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:24.120702 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:24.120998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:24.134083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a397f-a97c-450e-ae06-d134dc9d845f None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:24.139742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:24.141049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:24.184805 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:24.185896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:24.186658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:24.187040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:24.187415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:24.206334 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1372/2750] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:14:24.216796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:24.218556 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:24.231002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360367b3-111f-4526-b151-db7bdacc7ee5 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:24.234551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:24.235215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:24.235690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:24.236075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:24.245896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:24.247404 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:24.255780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:24.257254 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069042f-a397-43c1-bb16-4372102ff13d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:24.259518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1373/2751] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:14:24.268066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1379/2752] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:14:24.278313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:24.909075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:24.911269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:24.925612 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca82f8-9ab1-4f56-9e59-bf2b0aea1ac7 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:24.930456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:24.931088 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:24.931366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:24.931638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] PATH_INFO: `/v3/projects/bce154a624084b01a17b77e92ebd2e6b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:24.933230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bce154a624084b01a17b77e92ebd2e6b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:24.935190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:25.078897 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bce154a624084b01a17b77e92ebd2e6b', 'request_id': 'req-1d8374f3-ee85-424b-8b12-d24002b975d1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:25.086083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bce154a624084b01a17b77e92ebd2e6b', 'request_id': 'req-1d8374f3-ee85-424b-8b12-d24002b975d1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:25.092050 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bce154a624084b01a17b77e92ebd2e6b', 'request_id': 'req-1d8374f3-ee85-424b-8b12-d24002b975d1'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:25.220069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] The token cache is being invalidate because project bce154a624084b01a17b77e92ebd2e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:14:25.220398 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:25.221418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:14:25.223048 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1374/2753] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:14:24 2022] DELETE /identity/v3/projects/bce154a624084b01a17b77e92ebd2e6b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:14:30.630126 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9910-54aa-4e60-bc1a-186c8abd3e85 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:30.631530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9910-54aa-4e60-bc1a-186c8abd3e85 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:30.631530 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c9910-54aa-4e60-bc1a-186c8abd3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:30.664818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ae9c9910-54aa-4e60-bc1a-186c8abd3e85 None None] MFA Rules not processed for user `cbe43a17db274c5aa5188afca3f3710c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:30.666150 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ae9c9910-54aa-4e60-bc1a-186c8abd3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:30.742297 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1380/2754] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:30.761679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:30.761679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:30.836637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8374f3-ee85-424b-8b12-d24002b975d1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:30.842239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:30.842853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:30.843132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:30.843408 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:30.852706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:30.854614 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f678f1b-0cbd-43a6-9fde-3b147ec14b16 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:30.866662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1375/2755] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:33.788623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:33.789519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:33.789957 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:33.812003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] MFA Rules not processed for user `cbe43a17db274c5aa5188afca3f3710c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:33.813286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:33.822732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1381/2756] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:14:37.642945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:37.643848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:37.643848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:37.665204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:37.666505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:37.700919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:37.729671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1376/2757] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:37.763734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:37.777471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508e44c-3b27-4dc2-8ba6-6239afe32144 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:37.783233 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:37.783836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:37.784115 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:37.784419 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:37.793476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:37.795096 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f38507-75e7-4f85-a7f9-8f73e8322772 service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:37.806362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1382/2758] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:40.965137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:40.978154 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf57d39-3671-4495-8754-c3f06a9b810d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:40.983734 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:40.984456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:40.984732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:40.987689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:40.987689 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:40.999188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:41.000843 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:41.013247 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1377/2759] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:14:42.235157 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f074-34ec-4f68-bc90-e530218110ce None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:42.235736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f074-34ec-4f68-bc90-e530218110ce None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:42.235850 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7f074-34ec-4f68-bc90-e530218110ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:42.259738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5ed7f074-34ec-4f68-bc90-e530218110ce None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:42.261031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5ed7f074-34ec-4f68-bc90-e530218110ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:42.269077 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1383/2760] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:42.293741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:42.305170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2baac-af54-4c0c-bb23-4d151f509639 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:42.310855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:42.311450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:42.311731 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:42.312082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:42.321393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:42.323003 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:42.333296 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1378/2761] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:48.139568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368faa7-da9f-4e83-abdf-5c6eb188b17d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:48.140083 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368faa7-da9f-4e83-abdf-5c6eb188b17d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:48.140183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368faa7-da9f-4e83-abdf-5c6eb188b17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:48.160531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6368faa7-da9f-4e83-abdf-5c6eb188b17d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:48.161791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6368faa7-da9f-4e83-abdf-5c6eb188b17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:48.170738 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1384/2762] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:48.195413 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:48.196896 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:48.211831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c4979-a59a-490f-8d17-2eba25fa1fde service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:48.217378 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:48.217980 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:48.218243 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:48.218512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:48.227957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:48.229555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:48.238887 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1379/2763] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:53.455286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc096-77a2-4e3f-bf8e-ddd10fa16145 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:53.455983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc096-77a2-4e3f-bf8e-ddd10fa16145 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:53.455983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc096-77a2-4e3f-bf8e-ddd10fa16145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:53.479063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-a16fc096-77a2-4e3f-bf8e-ddd10fa16145 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:53.480639 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-a16fc096-77a2-4e3f-bf8e-ddd10fa16145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:53.488725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1385/2764] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:53.514935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:53.528501 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f13a99-f96f-40b2-b708-4e70480364da service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:53.534596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:53.535202 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:53.535481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:53.535753 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:53.545878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:53.547568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:53.561605 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1380/2765] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:14:57.771215 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:57.771812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:57.771812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:57.780021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=58 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:57.792940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:14:57.794093 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:14:57.802214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1386/2766] 10.222.0.102 () {58 vars in 1017 bytes} [Thu Sep 8 14:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:14:57.827259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:14:57.839608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabbba26-dd35-4927-9ee8-23c01d516fc9 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:14:57.845368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:14:57.845967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:14:57.846311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:14:57.846568 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:14:57.855846 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:14:57.857490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:14:57.867418 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1381/2767] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:07.841769 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:07.862626 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=40 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:36.630807 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:36.632433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:36.644984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d8811-8f9b-4691-8449-cb558659b826 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:36.649720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:36.650348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:36.650625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:36.650899 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] PATH_INFO: `/v3/users/dcc0547a756748d59aab763da81de4ca` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:36.652592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc0547a756748d59aab763da81de4ca)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:36.654522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:37.061015 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc0547a756748d59aab763da81de4ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.213000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc0547a756748d59aab763da81de4ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.226360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc0547a756748d59aab763da81de4ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.227308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc0547a756748d59aab763da81de4ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.234579 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-2f8baec0-d697-4c04-951b-8d93d494dbc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc0547a756748d59aab763da81de4ca'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.241313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1387/2768] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:15:36 2022] DELETE /identity/v3/users/dcc0547a756748d59aab763da81de4ca => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:37.557241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:37.570606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b107b04-5a24-470d-82c2-26ae4e69bae7 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:37.632322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:37.632961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:37.633245 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:37.633527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] PATH_INFO: `/v3/projects/7924bd9b19704d1c914c6abb8cdb5941` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:37.634737 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7924bd9b19704d1c914c6abb8cdb5941)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:37.636712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:37.755926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7924bd9b19704d1c914c6abb8cdb5941', 'request_id': 'req-09046ab5-4151-4ee5-ba05-46b6627c3fe7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.762422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7924bd9b19704d1c914c6abb8cdb5941', 'request_id': 'req-09046ab5-4151-4ee5-ba05-46b6627c3fe7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.768161 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7924bd9b19704d1c914c6abb8cdb5941', 'request_id': 'req-09046ab5-4151-4ee5-ba05-46b6627c3fe7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.922025 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] The token cache is being invalidate because project 7924bd9b19704d1c914c6abb8cdb5941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:15:37.922246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.922820 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-09046ab5-4151-4ee5-ba05-46b6627c3fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:15:37.924400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1382/2769] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:15:37 2022] DELETE /identity/v3/projects/7924bd9b19704d1c914c6abb8cdb5941 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:37.929335 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:37.932023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:37.932023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:37.950134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:37.951369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:38.012277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1388/2770] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:38.020996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.021289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.021570 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.041935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:38.043810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:38.052130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1383/2771] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:38.056468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.066400 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5811d24-c21e-4de2-9d9a-758cc9a58ea4 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.071047 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.071643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.071943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.072218 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.072884 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:15:38.073217 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.074774 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.086564 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1389/2772] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:15:38.091700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.101628 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558657d8-02e3-4b2e-8524-c1dd9e638803 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.107383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.108016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.108509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.108762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.113992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.113992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.254432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1384/2773] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:15:38 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:15:38.258815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.269839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e8c6f-a38b-49a4-bc2b-cca42bd9c5ab admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.326565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.327172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.327450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.327724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.328382 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.330278 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.338170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:38.435904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1390/2774] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:15:38 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:15:38.440165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.451044 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc46ce-6517-4e52-bf9b-616b7469c91e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.455824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.456494 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.456863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.457137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.457775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.459354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.470190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1385/2775] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:38.474227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.484667 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd875936-6e6f-4158-973d-197af15652d9 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.489643 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.490247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.490524 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.490802 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.491450 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.493112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7472686-55d6-4133-8be4-8f4b004719af admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.505292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1391/2776] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:38.509631 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.520177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d53c5b-70d6-4d7d-bc10-790061151ae4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.524834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.525600 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.525906 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.526151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] PATH_INFO: `/v3/projects/edfa1bcda12c4210a005d8f42db182d6/users/91ccf81e199947d69f61ba544762a9ff/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.542672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfa1bcda12c4210a005d8f42db182d6, user_id=91ccf81e199947d69f61ba544762a9ff, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.545349 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.728077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1386/2777] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:15:38 2022] PUT /identity/v3/projects/edfa1bcda12c4210a005d8f42db182d6/users/91ccf81e199947d69f61ba544762a9ff/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:38.733320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fde75-9840-428f-9318-f7c390cbc29d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.733620 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fde75-9840-428f-9318-f7c390cbc29d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.737324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fde75-9840-428f-9318-f7c390cbc29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.754228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-955fde75-9840-428f-9318-f7c390cbc29d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:38.755518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-955fde75-9840-428f-9318-f7c390cbc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:38.814369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1392/2778] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:38.824821 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:38.826519 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:38.857577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:38.884117 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5afe1-dace-4917-ad73-6e2db902d2d1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:38.888481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:38.889077 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:38.889364 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:38.889629 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:38.898963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:38.900409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:38.910160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1387/2779] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:45.290369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:45.290956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:45.290956 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:45.330188 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] MFA Rules not processed for user `91ccf81e199947d69f61ba544762a9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:45.331735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:45.423241 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1393/2780] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:45.427668 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:45.438082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa36e23-bb0d-4ccd-b07f-1233b52f6147 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:45.443186 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:45.443909 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:45.444217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:45.444551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:45.445241 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:45.447259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:45.608977 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1388/2781] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:15:45 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:15:45.614476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:45.623909 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c99209-5772-46b7-9303-7f6492bf7f91 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:45.686442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:45.687359 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:45.687655 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:45.688020 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:45.688840 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:45.690975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:45.796488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:15:45.803242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1394/2782] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:15:45 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:15:45.807368 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:45.818211 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf11ab7-6863-4e03-8dab-ccdf0d993e0e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:45.823138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:45.823840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:45.824757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:45.825146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:45.825880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:45.827550 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:45.839509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1389/2783] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:45.844373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:45.858288 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c755a04-0884-4ccc-8423-d74bc4fe788a admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:45.868651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:45.869435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:45.869811 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:45.870167 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] PATH_INFO: `/v3/projects/e963a59d8d6e4d9e917f889331367f20/users/1e410012e4b14cbd9c85d74d022e2777/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:45.890589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e963a59d8d6e4d9e917f889331367f20, user_id=1e410012e4b14cbd9c85d74d022e2777, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:45.893394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:45.986598 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1395/2784] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:15:45 2022] PUT /identity/v3/projects/e963a59d8d6e4d9e917f889331367f20/users/1e410012e4b14cbd9c85d74d022e2777/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:15:45.990638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:46.002852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e0ded-0057-45b9-bd6a-c3306a3a90dd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:46.085974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:46.086603 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:46.086888 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:46.087159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:46.087816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:46.089438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7072b-3af9-45f3-99da-23fb275fdcb1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:46.103604 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1390/2785] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:15:46.107823 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:46.118836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b6bbb-61d3-43c2-8b33-92693be7b7ba admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:46.124406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:46.125078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:46.125357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:46.125630 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] PATH_INFO: `/v3/projects/e963a59d8d6e4d9e917f889331367f20/users/1e410012e4b14cbd9c85d74d022e2777/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:46.127557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e963a59d8d6e4d9e917f889331367f20, user_id=1e410012e4b14cbd9c85d74d022e2777, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:46.130222 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:46.141784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1396/2786] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:15:46 2022] PUT /identity/v3/projects/e963a59d8d6e4d9e917f889331367f20/users/1e410012e4b14cbd9c85d74d022e2777/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:15:52.184289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80b71-f2a1-4776-9af7-59cb6ef0c395 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:52.184833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80b71-f2a1-4776-9af7-59cb6ef0c395 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:52.185046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a80b71-f2a1-4776-9af7-59cb6ef0c395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:52.220610 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-94a80b71-f2a1-4776-9af7-59cb6ef0c395 None None] MFA Rules not processed for user `1e410012e4b14cbd9c85d74d022e2777`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:52.222064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-94a80b71-f2a1-4776-9af7-59cb6ef0c395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:52.309642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1391/2787] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:15:52.326569 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:15:52.328476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:52.410534 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460c890-ae72-4ded-a67b-f8f9903b16fc admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:15:52.416559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:15:52.417183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:52.417499 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:52.417778 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:52.480044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:15:52.481993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:15:52.492401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1397/2788] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:15:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:15:56.688429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:15:56.689031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:15:56.689031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:15:56.709371 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] MFA Rules not processed for user `91ccf81e199947d69f61ba544762a9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:15:56.710496 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:15:56.717855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1392/2789] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:02.488007 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:06.703122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:19.134717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:19.136247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:19.192922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637561a5-e3bf-44dc-9370-9e0dc70f1d6f service nova] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:19.197053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:19.197673 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:19.197954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:19.198230 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:19.199933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:19.209901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:19.211348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9db6f1-58cb-4e4a-b07c-3baaebb95699 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:19.219989 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1398/2790] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:20.095622 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:20.097205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:20.171075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baad62e-2f69-4e7d-8878-ceca41b42ed1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:20.176492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:20.177141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:20.177427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:20.177701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:20.179679 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:20.203341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:20.203341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:20.205522 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1393/2791] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:27.742429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:27.743003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:27.743003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:27.762889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] MFA Rules not processed for user `cbe43a17db274c5aa5188afca3f3710c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:16:27.764129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:27.822858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1399/2792] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:16:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:16:30.200107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=32 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:34.081638 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:34.095826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9dd545-1534-4eaf-a848-66fea1342682 service placement] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:34.101796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:34.102995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:34.103462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:34.103914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:34.106002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:16:34.120523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:34.122396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:34.134181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1394/2793] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:37.816000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=51 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:39.102110 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:16:39.114141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461a22e-21a2-4e04-af1a-0db8e9557528 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:16:39.118031 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:16:39.118662 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:16:39.119003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:16:39.119277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:16:39.130208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:16:39.131681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb011b8-ddc6-4f3f-bc63-9a0af97e84ab service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:16:39.142458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1400/2794] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:16:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:16:44.129150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:49.137592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:17:41.371512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:17:41.382675 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938776f-60d1-4636-a904-133c68155c74 service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:17:41.387662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:17:41.388290 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:17:41.388576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:17:41.388851 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:17:41.390557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:17:41.403656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:17:41.405340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:17:41.415201 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1395/2795] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:17:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:17:51.411163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:17.470815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:18:17.473959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:18:17.473959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:18:17.490752 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] MFA Rules not processed for user `cbe43a17db274c5aa5188afca3f3710c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:18:17.491975 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:18:17.498987 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1401/2796] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:18:27.485377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:18.221353 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:18.230561 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2f181-a98a-4f01-8f8f-7d3e7835df96 service placement] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:18.234441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:18.235029 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:18.235316 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:18.235555 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:18.237282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:18.250642 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:18.252431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:18.263476 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1396/2797] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:19.451881 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:19.462149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723c130-2929-4426-9cad-a83185d16a27 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:19.465745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:19.466342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:19.466623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:19.466896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:19.468677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:19.483403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:19.484894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:19.496338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1402/2798] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:28.258601 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=6 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:28.566360 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:28.576768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41fd33-7cab-4473-9c31-7a30c7fc83c6 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:28.581840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:28.582889 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:28.583393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:28.583728 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:28.585535 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:28.596367 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:28.597795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:28.607116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1397/2799] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:29.491099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:33.054350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:33.064478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec49d51-be9c-4786-a6bb-08916c6019ce service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:33.068571 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:33.069178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:33.069458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:33.069737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:33.071538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:33.081804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:33.083229 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:33.091959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1403/2800] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:19:33.185654 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:33.195767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38362dc0-70dd-4608-b26b-c8830b1b89a1 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:33.201289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:33.202115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:33.202340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:33.202775 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:33.204683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:33.218947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:33.221162 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:33.232908 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1398/2801] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:19:43.088044 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=6 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:43.227525 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=12 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:19:58.940316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:19:58.984091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6aeaac-7bfe-4a6b-b291-51c9996a40ef service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:19:58.989720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:19:58.990324 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:19:58.990604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:19:58.990876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:19:58.992612 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:19:59.015002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:19:59.022757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48281a6-3ada-4177-999f-b9bf94386f4d service nova] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:19:59.027855 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1404/2802] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:19:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:20:09.022271 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=24 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:11.379055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:20:11.389858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:11.452953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389169b-eb16-4867-8204-35962bcfc18d service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:20:11.464947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a92f1d8d2904002b5f48ff217117039', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:20:11.464947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:11.464947 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:11.465282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:11.467319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:11.482203 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:20:11.485475 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:20:11.500395 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1399/2803] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:20:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:20:17.015980 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:20:17.017129 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:20:17.017488 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:20:17.044714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] MFA Rules not processed for user `cbe43a17db274c5aa5188afca3f3710c`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:20:17.045943 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:20:17.052866 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1405/2804] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:20:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:20:21.493151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=28 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:20:27.039424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:23.237762 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:23.257741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3fb11-141b-4bf3-8a04-97a75615773e service nova] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:23.261439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:23.262042 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:23.262323 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:23.262594 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:23.271722 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:23.273172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:23.283292 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1400/2805] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:30.333928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:30.344422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c18a04-8aae-4b77-af39-261d507c7ff0 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:30.348190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:30.348826 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:30.349104 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:30.349373 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:30.443453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:30.444854 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:30.466476 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1406/2806] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:21:33.278373 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=10 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:34.126462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:34.138265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808cf64-0d2c-49f4-a465-e67286a7fba2 service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:34.143666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:34.144562 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:34.145012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:34.145439 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:34.147390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:34.161390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:34.163276 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:34.175016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1401/2807] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:21:38.129180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:38.143648 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc29-4b62-4133-8987-429f5da84070 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:38.148517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:38.149099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:38.149376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:38.149684 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] PATH_INFO: `/v3/users/91ccf81e199947d69f61ba544762a9ff` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:38.150891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91ccf81e199947d69f61ba544762a9ff)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:38.152872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:38.406891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91ccf81e199947d69f61ba544762a9ff'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.498645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91ccf81e199947d69f61ba544762a9ff'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.513597 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91ccf81e199947d69f61ba544762a9ff'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.514424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91ccf81e199947d69f61ba544762a9ff'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.522466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91ccf81e199947d69f61ba544762a9ff'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:38.528557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1407/2808] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:38 2022] DELETE /identity/v3/users/91ccf81e199947d69f61ba544762a9ff => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:39.062686 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.066456 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142723c-f3a7-4441-83dc-679e863d6dad service placement] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.140235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.140919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.141204 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.141484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] PATH_INFO: `/v3/projects/edfa1bcda12c4210a005d8f42db182d6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.142844 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfa1bcda12c4210a005d8f42db182d6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.144721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.265185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfa1bcda12c4210a005d8f42db182d6', 'request_id': 'req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.271477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfa1bcda12c4210a005d8f42db182d6', 'request_id': 'req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.277363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfa1bcda12c4210a005d8f42db182d6', 'request_id': 'req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.431231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] The token cache is being invalidate because project edfa1bcda12c4210a005d8f42db182d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:39.431483 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.432035 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.433532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1402/2809] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:39 2022] DELETE /identity/v3/projects/edfa1bcda12c4210a005d8f42db182d6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:39.437682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:39.439179 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:39.452617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300ace9-1bd6-44c3-9a3d-7943eed70541 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:39.498302 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:39.510061 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:39.513947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:39.513947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:39.513947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] PATH_INFO: `/v3/users/1e410012e4b14cbd9c85d74d022e2777` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:39.513947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e410012e4b14cbd9c85d74d022e2777)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:39.514384 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:39.832646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e410012e4b14cbd9c85d74d022e2777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.944724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e410012e4b14cbd9c85d74d022e2777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.958682 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e410012e4b14cbd9c85d74d022e2777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.959338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e410012e4b14cbd9c85d74d022e2777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.966661 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e410012e4b14cbd9c85d74d022e2777'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:39.973344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1408/2810] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:21:39 2022] DELETE /identity/v3/users/1e410012e4b14cbd9c85d74d022e2777 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:40.266194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:21:40.268283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:21:40.281684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ba940-00a1-43ea-8b9e-1da2da0cbbf7 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:21:40.342452 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:21:40.343024 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:21:40.343238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:21:40.343520 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] PATH_INFO: `/v3/projects/e963a59d8d6e4d9e917f889331367f20` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:21:40.344684 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e963a59d8d6e4d9e917f889331367f20)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:21:40.347239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:21:40.355549 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:40.499840 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e963a59d8d6e4d9e917f889331367f20', 'request_id': 'req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:40.506393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e963a59d8d6e4d9e917f889331367f20', 'request_id': 'req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:40.512158 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e963a59d8d6e4d9e917f889331367f20', 'request_id': 'req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:40.651703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] The token cache is being invalidate because project e963a59d8d6e4d9e917f889331367f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:21:40.651931 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:40.652701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:21:40.654495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1403/2811] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:21:40 2022] DELETE /identity/v3/projects/e963a59d8d6e4d9e917f889331367f20 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:21:49.969178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:50.692945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:06.295231 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:06.296669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:06.373614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590ecf1-6cc1-4ed5-b048-faf326ee2b5b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:06.422481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:06.423091 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:06.423370 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:06.423642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:06.425485 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:06.489764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:06.491224 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:06.501148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1409/2812] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:10.277130 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:10.278935 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:10.291932 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1ac3d-b313-4d72-bbdc-e92d4a7f693e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:10.296528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:10.297165 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:10.297509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:10.297777 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] PATH_INFO: `/v3/users/cbe43a17db274c5aa5188afca3f3710c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:10.298933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe43a17db274c5aa5188afca3f3710c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:10.301436 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:10.478545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe43a17db274c5aa5188afca3f3710c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:10.491822 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe43a17db274c5aa5188afca3f3710c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:10.492585 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe43a17db274c5aa5188afca3f3710c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:10.500183 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe43a17db274c5aa5188afca3f3710c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:10.596505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-0e1954a2-005c-4193-9b50-cd607ab18819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe43a17db274c5aa5188afca3f3710c'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:10.603534 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1404/2813] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:10 2022] DELETE /identity/v3/users/cbe43a17db274c5aa5188afca3f3710c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:10.867633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:10.882079 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca6eaf-a82f-4de6-9cde-63f939b18e40 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:10.936243 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:10.943340 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:10.949202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:10.949202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:10.949202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] PATH_INFO: `/v3/projects/42a7f86c5ab44aa5b45475217ea8e806` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:10.949202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a7f86c5ab44aa5b45475217ea8e806)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:10.949202 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.063979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a7f86c5ab44aa5b45475217ea8e806', 'request_id': 'req-dbc05459-a548-42f9-815b-a22e7919baa5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:11.121865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a7f86c5ab44aa5b45475217ea8e806', 'request_id': 'req-dbc05459-a548-42f9-815b-a22e7919baa5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:11.128948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a7f86c5ab44aa5b45475217ea8e806', 'request_id': 'req-dbc05459-a548-42f9-815b-a22e7919baa5'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:11.141886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] The token cache is being invalidate because project 42a7f86c5ab44aa5b45475217ea8e806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:11.142174 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:11.142851 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dbc05459-a548-42f9-815b-a22e7919baa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:11.144937 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1410/2814] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:10 2022] DELETE /identity/v3/projects/42a7f86c5ab44aa5b45475217ea8e806 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:11.149944 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.150218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.150481 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.212508 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:11.213708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:11.272828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1405/2815] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:11.281148 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.281719 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.282000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.302905 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:11.304138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:11.312069 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1411/2816] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:11.317163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.327190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082a00-d938-4376-99c7-b5202fbf4b31 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.331732 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.332951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.333218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.333493 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.334132 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:11.334427 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.336058 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.348040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1406/2817] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:22:11.352446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.362009 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d71f-f698-49a3-801f-35c7edc36a62 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.366592 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.367178 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.367446 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.367724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.368392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.370558 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.477863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1412/2818] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:11.487216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.498581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec680d-dcdd-43ef-a7b7-2bbe86f0f9fb admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.532146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:11.568129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.568129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.568129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.568129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.571240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.571240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.653669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1407/2819] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:11.657959 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.669568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414d221-5fd7-4a59-8d0a-1c823049d998 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.674541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.675131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.675403 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.675668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.676830 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.678405 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.689665 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1413/2820] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:11.701919 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.712293 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c2bb-6363-40a1-aff1-b9804fff2cc2 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.717403 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.718015 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.718288 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.718554 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.719191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.720880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69351a34-3d63-427a-86f3-5e3071b1a756 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.732672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1408/2821] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:11.737344 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:11.748503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6094d-2fef-4fcd-95d5-ff39eada1104 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:11.753159 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:11.753847 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.754704 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.754988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] PATH_INFO: `/v3/projects/6fc7c8b464b1490090e7dc84f9604bac/users/de9cf6548fad472cafe6e3658084beb4/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.770828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc7c8b464b1490090e7dc84f9604bac, user_id=de9cf6548fad472cafe6e3658084beb4, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:11.773533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:11.836475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1414/2822] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:11 2022] PUT /identity/v3/projects/6fc7c8b464b1490090e7dc84f9604bac/users/de9cf6548fad472cafe6e3658084beb4/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:11.847920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:11.848236 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:11.848509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:11.876581 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] MFA Rules not processed for user `de9cf6548fad472cafe6e3658084beb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:11.877718 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:11.940924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1409/2823] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:11.946474 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.009338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94da28-2e2b-46fc-83b5-15d50e0b8e7b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.014057 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.018377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.018377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.018377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.018377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.018377 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.093435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:12.102436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1415/2824] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:11 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:12.107391 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.120129 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aebdacf-816e-4fd8-abf1-715b278a5902 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.175472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.176660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.176943 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.177216 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.177870 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.179800 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.310543 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1410/2825] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:12 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:22:12.314537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.326284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360f830-9447-4c8c-83b2-d83459d73915 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.330862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.331465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.331845 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.332608 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.333235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.334822 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.345429 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1416/2826] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:12.349670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.359842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f493d4-0e50-4acd-b853-bc1271405740 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.364801 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.365455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.365735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.366012 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] PATH_INFO: `/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946/users/fbbda724d75e4c5ba98b57ac4c8a0405/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.381061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3a26f54c3e44169f1c8fefe6b2a946, user_id=fbbda724d75e4c5ba98b57ac4c8a0405, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.383705 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.511188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1411/2827] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:12 2022] PUT /identity/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946/users/fbbda724d75e4c5ba98b57ac4c8a0405/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:12.515284 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.525221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dc8e3-a432-4303-94a3-c89785396001 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.582935 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.583593 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.583872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.584140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.584864 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.586420 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d035be-4e5e-45ad-886a-817919ce0879 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.596858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1417/2828] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:12.601218 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.606758 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:12.612748 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680b358-5c54-400a-b2a1-76a81138ce99 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.618189 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.618857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.619141 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.619424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] PATH_INFO: `/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946/users/fbbda724d75e4c5ba98b57ac4c8a0405/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.621382 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3a26f54c3e44169f1c8fefe6b2a946, user_id=fbbda724d75e4c5ba98b57ac4c8a0405, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.624278 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.635810 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1412/2829] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:12 2022] PUT /identity/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946/users/fbbda724d75e4c5ba98b57ac4c8a0405/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:12.646270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.646561 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.646872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.676557 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] MFA Rules not processed for user `fbbda724d75e4c5ba98b57ac4c8a0405`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:12.677788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:12.752848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1418/2830] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:12.765055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:12.767431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:12.871558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe28f27-a339-4508-aa63-5a9ec123a5f1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:12.877210 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:12.878254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:12.878764 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:12.879298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:12.895692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:12.898576 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf00d9-7524-4e68-b0c1-68f60c4df498 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:12.917030 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1413/2831] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:13.813100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:13.891670 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f569-6951-4f5e-bedb-0b71e0368950 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:13.896397 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:13.897085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:13.897332 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:13.897614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] PATH_INFO: `/v3/users/de9cf6548fad472cafe6e3658084beb4` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:13.898794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9cf6548fad472cafe6e3658084beb4)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:13.900784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:13.913659 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=100 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:14.121186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9cf6548fad472cafe6e3658084beb4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.201983 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9cf6548fad472cafe6e3658084beb4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.215125 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9cf6548fad472cafe6e3658084beb4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.215804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9cf6548fad472cafe6e3658084beb4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.222887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9cf6548fad472cafe6e3658084beb4'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.228878 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1419/2832] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:13 2022] DELETE /identity/v3/users/de9cf6548fad472cafe6e3658084beb4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:14.233420 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:14.233940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:14.234046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:14.255485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:14.256735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:14.317294 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1414/2833] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:14.327342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:14.328797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:14.386603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b871d-fd0f-4c11-9ddc-effd83cb9807 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:14.390118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:14.390724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:14.391003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:14.391277 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:14.400998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:14.402422 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:14.413168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1420/2834] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:14.843451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:14.848430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:14.858848 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965eabe-8dce-4464-8e36-877c0ececeff None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:14.863907 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:14.864592 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:14.864873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:14.865166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] PATH_INFO: `/v3/projects/6fc7c8b464b1490090e7dc84f9604bac` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:14.867105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc7c8b464b1490090e7dc84f9604bac)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:14.873170 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:14.963400 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc7c8b464b1490090e7dc84f9604bac', 'request_id': 'req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.969719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc7c8b464b1490090e7dc84f9604bac', 'request_id': 'req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.975953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc7c8b464b1490090e7dc84f9604bac', 'request_id': 'req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:14.979670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:15.075220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] The token cache is being invalidate because project 6fc7c8b464b1490090e7dc84f9604bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:15.075453 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.075939 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.077502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1415/2835] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:14 2022] DELETE /identity/v3/projects/6fc7c8b464b1490090e7dc84f9604bac => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:15.081562 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:15.092214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162beb7-859e-4423-b17f-c303b3313576 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:15.152843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:15.153471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:15.153745 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:15.154011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] PATH_INFO: `/v3/users/fbbda724d75e4c5ba98b57ac4c8a0405` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:15.155177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbda724d75e4c5ba98b57ac4c8a0405)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:15.157109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:15.312156 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:15.325358 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbda724d75e4c5ba98b57ac4c8a0405'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.401843 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbda724d75e4c5ba98b57ac4c8a0405'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.415186 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbda724d75e4c5ba98b57ac4c8a0405'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.415897 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbda724d75e4c5ba98b57ac4c8a0405'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.422997 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d90625b8-d922-4ea5-8848-06227eceefee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbda724d75e4c5ba98b57ac4c8a0405'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:15.429421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1421/2836] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:15 2022] DELETE /identity/v3/users/fbbda724d75e4c5ba98b57ac4c8a0405 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:15.855393 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:15.856733 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:15.871772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd513d-fed4-4784-bca9-13fcd6f87cb9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:15.930796 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:15.931432 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:15.931712 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:15.931987 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] PATH_INFO: `/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:15.933160 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3a26f54c3e44169f1c8fefe6b2a946)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:15.935060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.048451 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3a26f54c3e44169f1c8fefe6b2a946', 'request_id': 'req-a7c028ac-da90-45b4-b5ea-2268c311c64a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:16.055586 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3a26f54c3e44169f1c8fefe6b2a946', 'request_id': 'req-a7c028ac-da90-45b4-b5ea-2268c311c64a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:16.061814 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3a26f54c3e44169f1c8fefe6b2a946', 'request_id': 'req-a7c028ac-da90-45b4-b5ea-2268c311c64a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:16.138966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] The token cache is being invalidate because project 3e3a26f54c3e44169f1c8fefe6b2a946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:16.139179 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:16.139790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a7c028ac-da90-45b4-b5ea-2268c311c64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:16.141344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1416/2837] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:15 2022] DELETE /identity/v3/projects/3e3a26f54c3e44169f1c8fefe6b2a946 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:16.146347 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.146856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.146964 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.167574 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:16.171318 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:16.229906 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1422/2838] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:16.239596 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.239890 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.240168 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.261874 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:16.263100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:16.274537 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1417/2839] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:16.279023 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.292001 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199605a-01a1-427a-8468-9a79fba7d1ff None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.297353 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.297985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.298270 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.298549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.299213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:16.299521 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.301180 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.314484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1423/2840] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:22:16.319017 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.328724 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f32144-8cbe-44b6-8e52-8af413ddd4cd None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.334064 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.334682 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.334963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.335238 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.335881 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.337925 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.455207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1418/2841] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:16.464155 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.475458 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76c078-3b9f-4799-be73-6267ff0e1131 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.543606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.544247 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.544531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.544832 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.545468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.547433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.620414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1424/2842] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:16.624665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.635997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f068f9e-7399-4ad5-b4df-53f993f8c1b1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.640726 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.641322 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.641598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.641960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.643545 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.644097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.655790 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1419/2843] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:16.662720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.673427 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e78a8-adaa-40dc-a8b8-40c51eee7e14 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.679191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.679804 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.680085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.680394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.681072 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.682674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288d0e2-9924-4633-b037-0f5dcae129c5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.694669 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1425/2844] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:16.699190 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.711283 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a9ceb-4fab-46ac-9c16-f019e1ff5cc1 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:16.715963 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:16.716692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.717099 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.717390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] PATH_INFO: `/v3/projects/015d01b5c40c476fb29772f3485657ee/users/e1c6727f71c046f2814b45054eb17f65/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.732966 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015d01b5c40c476fb29772f3485657ee, user_id=e1c6727f71c046f2814b45054eb17f65, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:16.735917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:16.814146 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1420/2845] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:16 2022] PUT /identity/v3/projects/015d01b5c40c476fb29772f3485657ee/users/e1c6727f71c046f2814b45054eb17f65/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:16.826059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:16.826342 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:16.826615 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:16.858838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] MFA Rules not processed for user `e1c6727f71c046f2814b45054eb17f65`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:16.860105 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:16.864880 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:16.954038 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1426/2846] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:16.959057 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:16.986507 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:17.028552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e960bd-c457-4dac-b2d1-052b50886b99 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.033855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.034565 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.034853 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.035136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.036067 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.039140 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.141512 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1421/2847] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:16 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:17.145976 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.157759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33c325-df83-431a-b319-6e657ad8db8a None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.220137 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.220805 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.221080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.221356 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.221984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.223901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.305914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1427/2848] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:17 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:17.310359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.321533 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1384bf-a336-497e-b492-ff87a70f484b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.326392 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.327000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.327281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.327557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.328229 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.329842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.340954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1422/2849] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:17.345691 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.357266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c1e31b-8790-4a01-ac82-896ca93a144b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.362209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.362894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.363175 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.363595 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] PATH_INFO: `/v3/projects/d1107f85c4f64c86ac425f1022c302ba/users/56cc23c9dc2c478583886567c5b13072/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.379936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1107f85c4f64c86ac425f1022c302ba, user_id=56cc23c9dc2c478583886567c5b13072, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.382603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.499668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1428/2850] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:17 2022] PUT /identity/v3/projects/d1107f85c4f64c86ac425f1022c302ba/users/56cc23c9dc2c478583886567c5b13072/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:17.503786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.514174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040803b4-1ab8-4b6a-ae98-f58355ed865e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.573046 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.573671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.573955 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.574230 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.574878 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.576502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1f249-1910-42b6-8401-3f17975c0993 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.587092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1423/2851] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:17.592130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.603287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72686520-12ac-432f-9983-4de2e6c10c74 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.608035 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.608709 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.608984 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.609257 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] PATH_INFO: `/v3/projects/d1107f85c4f64c86ac425f1022c302ba/users/56cc23c9dc2c478583886567c5b13072/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.611414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1107f85c4f64c86ac425f1022c302ba, user_id=56cc23c9dc2c478583886567c5b13072, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.614701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.625541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1429/2852] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:17 2022] PUT /identity/v3/projects/d1107f85c4f64c86ac425f1022c302ba/users/56cc23c9dc2c478583886567c5b13072/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:17.635900 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.636254 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.636538 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.666640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] MFA Rules not processed for user `56cc23c9dc2c478583886567c5b13072`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:17.667858 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:17.740837 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1424/2853] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:17.753360 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:17.755154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:17.818468 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b846-98e7-4b15-b43d-af5c2745b911 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:17.822303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:17.822856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:17.823133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:17.823404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:17.834475 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:17.885308 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:17.886721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:17.897472 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1430/2854] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:19.790200 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:19.791823 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:19.805455 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3447221-40a2-47fc-8eb8-2b75205719e1 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:19.809450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:19.810053 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:19.810330 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:19.810613 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:19.821351 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:19.822630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6129a-c93d-48b2-972f-15c413f05546 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:19.833606 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1425/2855] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:25.536404 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:25.633196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cfbcc-d6a2-45f7-868f-209528cfbe63 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:25.640702 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:25.641386 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:25.642527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:25.642527 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] PATH_INFO: `/v3/users/e1c6727f71c046f2814b45054eb17f65` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:25.643151 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c6727f71c046f2814b45054eb17f65)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:25.645239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:25.867025 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c6727f71c046f2814b45054eb17f65'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:25.939416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c6727f71c046f2814b45054eb17f65'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:25.954392 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c6727f71c046f2814b45054eb17f65'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:25.955304 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c6727f71c046f2814b45054eb17f65'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:25.965442 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c6727f71c046f2814b45054eb17f65'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:25.972624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1431/2856] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:25 2022] DELETE /identity/v3/users/e1c6727f71c046f2814b45054eb17f65 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:25.978037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:25.978738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:25.978738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:25.987690 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:25.999879 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:26.001155 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:26.069305 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1426/2857] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:22:26.079363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:26.081108 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:26.123056 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:26.149801 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22e8e-ad01-4439-8a80-542cedf4279d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:26.154002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:26.154638 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:26.154915 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:26.155187 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:26.166369 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:26.167863 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:26.179191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1432/2858] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:26.658978 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:26.660954 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:26.674750 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62affd-76da-446c-ada2-610ba361ab0e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:26.680430 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:26.681194 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:26.681467 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:26.681735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] PATH_INFO: `/v3/projects/015d01b5c40c476fb29772f3485657ee` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:26.682993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] RBAC: Authorizing `identity:delete_project(project_id=015d01b5c40c476fb29772f3485657ee)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:26.685049 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:26.810696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015d01b5c40c476fb29772f3485657ee', 'request_id': 'req-b630164e-a119-4b0a-be4d-94c24d2a893f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:26.819608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015d01b5c40c476fb29772f3485657ee', 'request_id': 'req-b630164e-a119-4b0a-be4d-94c24d2a893f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:26.826485 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015d01b5c40c476fb29772f3485657ee', 'request_id': 'req-b630164e-a119-4b0a-be4d-94c24d2a893f'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:26.917757 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] The token cache is being invalidate because project 015d01b5c40c476fb29772f3485657ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:26.917993 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:26.919108 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:26.920441 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1427/2859] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:26 2022] DELETE /identity/v3/projects/015d01b5c40c476fb29772f3485657ee => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:26.924765 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:26.935757 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd018a97-053e-41bd-9db3-04cf7b15bada service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:26.997109 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:26.997759 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:26.998040 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:26.998316 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] PATH_INFO: `/v3/users/56cc23c9dc2c478583886567c5b13072` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:26.999477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cc23c9dc2c478583886567c5b13072)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:27.001435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:27.216960 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cc23c9dc2c478583886567c5b13072'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.288138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cc23c9dc2c478583886567c5b13072'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.304255 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cc23c9dc2c478583886567c5b13072'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.304998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cc23c9dc2c478583886567c5b13072'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.312426 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-981e571e-28f8-4425-8692-74b6677fc78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cc23c9dc2c478583886567c5b13072'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.318498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1433/2860] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:26 2022] DELETE /identity/v3/users/56cc23c9dc2c478583886567c5b13072 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:27.790618 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:27.792096 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:27.812794 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630164e-a119-4b0a-be4d-94c24d2a893f admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:27.867311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:27.867948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:27.868246 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:27.868523 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] PATH_INFO: `/v3/projects/d1107f85c4f64c86ac425f1022c302ba` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:27.869763 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1107f85c4f64c86ac425f1022c302ba)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:27.871665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:27.970657 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:27.985234 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1107f85c4f64c86ac425f1022c302ba', 'request_id': 'req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:27.992960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1107f85c4f64c86ac425f1022c302ba', 'request_id': 'req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:28.000136 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1107f85c4f64c86ac425f1022c302ba', 'request_id': 'req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:28.084670 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] The token cache is being invalidate because project d1107f85c4f64c86ac425f1022c302ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:28.084929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:28.085509 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-8f01b2da-76a2-4a33-8f2f-7d35c9434aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:28.087061 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1428/2861] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:27 2022] DELETE /identity/v3/projects/d1107f85c4f64c86ac425f1022c302ba => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:28.092067 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.092596 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.092703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.114203 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:28.115605 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:28.170443 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:28.183714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1434/2862] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:28.248742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.249013 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.249269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.270429 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:28.271649 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:28.280532 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1429/2863] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:28.287410 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.297303 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22763e3f-b3b1-4a02-ace7-9fcd80d43a55 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.302701 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.303511 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.303697 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.303947 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.304712 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:28.305012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.306606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.320182 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1435/2864] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:22:28.324578 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.334126 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f21f26-d173-41e4-ab7d-626abbf25b45 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.340375 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.340917 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.341191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.341461 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.342083 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.344958 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.433344 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1430/2865] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:28.438572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.450484 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56282cb8-3324-42ef-8dbe-4068d0f319b8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.513681 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.514402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.514707 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.515162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.515951 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.517756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.637295 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1436/2866] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:28.644658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.656172 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fcfea-7b3b-4478-8e36-c1d309e437cb admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.664567 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.668630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.668630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.668630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.668630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.668630 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.683143 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1431/2867] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:28.687394 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.698322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98a18c-a07f-4571-84c1-77d1f22618e3 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.703509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.704219 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.704515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.704820 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.705471 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.707089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9319a8-1f4d-478e-93ce-a1733cce7841 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.718901 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1437/2868] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:28.730924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:28.742416 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2be436-646d-4025-81e3-d738f43994ac admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:28.747282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:28.750544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.750544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.750544 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] PATH_INFO: `/v3/projects/4adc393f64a64b8eb3bfc1aae691893c/users/3c24c1282c694cd7bad308187c4314af/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.765960 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adc393f64a64b8eb3bfc1aae691893c, user_id=3c24c1282c694cd7bad308187c4314af, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:28.768942 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:28.837122 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1432/2869] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:28 2022] PUT /identity/v3/projects/4adc393f64a64b8eb3bfc1aae691893c/users/3c24c1282c694cd7bad308187c4314af/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:28.847555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:28.847846 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:28.848123 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:28.879192 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] MFA Rules not processed for user `3c24c1282c694cd7bad308187c4314af`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:28.881228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:28.963004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1438/2870] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:28.967692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.041097 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d494200-4d7e-46b3-97c6-2ced197976ae admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.046450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.046950 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.047231 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.047504 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.048159 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.050150 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.147063 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1433/2871] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:28 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:29.151246 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.163227 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8aaef9-44bb-4b0f-a0e7-a91ab7344bc2 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.212495 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:29.224988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.225510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.225791 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.226059 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.226703 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.228721 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.351580 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1439/2872] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:29 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:22:29.356569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.368359 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79fa37-5648-4b36-ac8d-198285298788 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.373324 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.373951 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.374259 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.374531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.375205 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.376876 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.389869 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1434/2873] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:29.394585 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.405677 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf7924-d2df-4dd7-95de-b490b28afa64 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.410690 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.411416 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.411735 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.412011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] PATH_INFO: `/v3/projects/ccb8ec19fff649e7934332871baef293/users/0e416a2cd09b4cd98540a6d1b93ef62e/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.429797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8ec19fff649e7934332871baef293, user_id=0e416a2cd09b4cd98540a6d1b93ef62e, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.432622 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.507261 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1440/2874] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:29 2022] PUT /identity/v3/projects/ccb8ec19fff649e7934332871baef293/users/0e416a2cd09b4cd98540a6d1b93ef62e/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:29.511706 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.522936 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11b5e0-9077-4b9f-b6c3-e0a8d503fc79 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.550723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:29.583741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.584396 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.584683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.584964 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.585608 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.587221 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de89f3-5781-4f78-9d52-4198a86f0c5c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.599557 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1435/2875] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:29.603986 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.615022 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd838838-bc6c-425c-8cdb-6296a6b0c5c0 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.619892 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.620607 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.620891 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.621169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] PATH_INFO: `/v3/projects/ccb8ec19fff649e7934332871baef293/users/0e416a2cd09b4cd98540a6d1b93ef62e/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.623173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb8ec19fff649e7934332871baef293, user_id=0e416a2cd09b4cd98540a6d1b93ef62e, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.625886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.638214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1441/2876] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:29 2022] PUT /identity/v3/projects/ccb8ec19fff649e7934332871baef293/users/0e416a2cd09b4cd98540a6d1b93ef62e/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:29.650793 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.651075 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.653144 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.683838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] MFA Rules not processed for user `0e416a2cd09b4cd98540a6d1b93ef62e`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:29.685128 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:29.766677 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1436/2877] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:29.778460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:29.781228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:29.850942 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340df032-7551-49cb-bf4c-c7df1bad0778 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:29.854930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:29.855644 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:29.856006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:29.856501 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:29.872183 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:29.873658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:29.885099 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1442/2878] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:29.993996 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:30.004192 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bb096-ce87-4e41-9ba4-d0ead4fda249 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:30.008791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:30.009423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:30.009703 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:30.009974 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:30.079530 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:30.080923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b60ee6-ce6a-45d3-82a6-891a12a7590f service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:30.091051 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1437/2879] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:33.552794 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:33.623084 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b3ad2-135e-4067-bb22-779f1828d7e9 service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:33.627865 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:33.628548 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:33.629322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:33.629322 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] PATH_INFO: `/v3/users/3c24c1282c694cd7bad308187c4314af` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:33.630797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c24c1282c694cd7bad308187c4314af)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:33.632764 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:33.838172 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:33.839858 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c24c1282c694cd7bad308187c4314af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:33.921189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c24c1282c694cd7bad308187c4314af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:33.934645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c24c1282c694cd7bad308187c4314af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:33.935314 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c24c1282c694cd7bad308187c4314af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:33.942312 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c24c1282c694cd7bad308187c4314af'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:33.948185 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1443/2880] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:33 2022] DELETE /identity/v3/users/3c24c1282c694cd7bad308187c4314af => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:33.952646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:33.953133 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:33.953240 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:33.971857 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:33.973080 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:34.017484 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=100 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:34.032113 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1438/2881] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:34.042376 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:34.043779 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:34.101883 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa99a1-177b-4e4c-8109-2b77889c75a5 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:34.105497 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:34.111586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:34.111586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:34.111586 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:34.117338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:34.118766 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:34.128401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1444/2882] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:34.529771 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:34.532924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:34.545579 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fbbda-7973-46ea-a1c9-dc02186b185d None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:34.550450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:34.551715 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:34.552185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:34.552488 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] PATH_INFO: `/v3/projects/4adc393f64a64b8eb3bfc1aae691893c` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:34.553651 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adc393f64a64b8eb3bfc1aae691893c)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:34.555767 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:34.695242 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adc393f64a64b8eb3bfc1aae691893c', 'request_id': 'req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:34.701620 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adc393f64a64b8eb3bfc1aae691893c', 'request_id': 'req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:34.709911 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adc393f64a64b8eb3bfc1aae691893c', 'request_id': 'req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:34.796992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] The token cache is being invalidate because project 4adc393f64a64b8eb3bfc1aae691893c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:34.796992 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:34.797357 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:34.798683 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1439/2883] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:34 2022] DELETE /identity/v3/projects/4adc393f64a64b8eb3bfc1aae691893c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:34.802936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:34.813292 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a9dbb-45f5-4e90-8f0c-d225a4deb18d service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:34.876194 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:34.876862 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:34.877142 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:34.877418 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] PATH_INFO: `/v3/users/0e416a2cd09b4cd98540a6d1b93ef62e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:34.878552 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e416a2cd09b4cd98540a6d1b93ef62e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:34.881191 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:35.049393 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e416a2cd09b4cd98540a6d1b93ef62e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.122466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e416a2cd09b4cd98540a6d1b93ef62e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.134813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:35.137725 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e416a2cd09b4cd98540a6d1b93ef62e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.138396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e416a2cd09b4cd98540a6d1b93ef62e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.145686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-9ad734ec-5863-49c8-bd85-7261720ac200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e416a2cd09b4cd98540a6d1b93ef62e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.152357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1445/2884] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:34 2022] DELETE /identity/v3/users/0e416a2cd09b4cd98540a6d1b93ef62e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:35.598137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:35.600174 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:35.616824 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4f2b-06df-4ecb-b40a-facadf0b9e5a admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:35.675539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:35.676175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:35.677152 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:35.677434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] PATH_INFO: `/v3/projects/ccb8ec19fff649e7934332871baef293` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:35.678566 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb8ec19fff649e7934332871baef293)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:35.680559 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:35.797660 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb8ec19fff649e7934332871baef293', 'request_id': 'req-79a8119c-d9c2-4c49-9769-7ff031986806'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.803983 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb8ec19fff649e7934332871baef293', 'request_id': 'req-79a8119c-d9c2-4c49-9769-7ff031986806'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.809624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb8ec19fff649e7934332871baef293', 'request_id': 'req-79a8119c-d9c2-4c49-9769-7ff031986806'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.875492 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] The token cache is being invalidate because project ccb8ec19fff649e7934332871baef293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:35.875856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.876518 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-79a8119c-d9c2-4c49-9769-7ff031986806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:35.878073 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1440/2885] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:35 2022] DELETE /identity/v3/projects/ccb8ec19fff649e7934332871baef293 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:35.883012 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:35.883502 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:35.886463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:35.904028 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:35.905286 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:35.967720 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1446/2886] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:35.976284 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:35.976573 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:35.976852 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:35.984831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:35.998107 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:35.999339 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:36.007650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1441/2887] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:36.012101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.022503 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd59a0-335d-442e-aebf-4bc6914200a3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.027406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.027922 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.028221 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.028510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.029168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:36.029911 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.031078 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.044993 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1447/2888] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:22:36.049425 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.058957 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086047c5-4822-4bf9-90cc-603bfcc0bb9e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.063680 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.064377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.064609 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.064880 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.065539 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.067920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.153825 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1442/2889] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:36 2022] POST /identity/v3/projects => generated 407 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:36.157902 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.168361 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5628a-7b04-4b99-a499-d83f63441b02 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.225509 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.226130 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.226395 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.226668 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.227289 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.229242 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.350336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1448/2890] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:36 2022] POST /identity/v3/users => generated 304 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:36.354552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.364948 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e705-1c77-4ec9-9497-9c405582212c admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.370517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.370517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.370517 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.370855 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.371235 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.372863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.383116 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1443/2891] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:36.387106 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.398205 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0584be-2570-4c14-9446-59b649d1373d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.403133 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.403723 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.404053 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.404305 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.404940 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.406522 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cd9350-3aa2-42ad-9f33-0d02446486a0 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.418085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1449/2892] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:36.422363 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.432772 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5bd89-5b41-4c4e-9f78-9e5d167a0b2d admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.437291 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.437933 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.438215 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.438490 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] PATH_INFO: `/v3/projects/0b58d890a6ca499b96f5a9f442a1afe9/users/6ed86253ec3f47b9ad7de9a5261b80b0/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.454311 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b58d890a6ca499b96f5a9f442a1afe9, user_id=6ed86253ec3f47b9ad7de9a5261b80b0, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.456995 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.557255 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1444/2893] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:36 2022] PUT /identity/v3/projects/0b58d890a6ca499b96f5a9f442a1afe9/users/6ed86253ec3f47b9ad7de9a5261b80b0/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:36.568749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.568970 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.569244 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.598399 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] MFA Rules not processed for user `6ed86253ec3f47b9ad7de9a5261b80b0`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:36.599642 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:36.642112 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:36.667618 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1450/2894] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:36.672358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.767863 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c5f0b-64a2-4d33-8797-967bc9ea3a43 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.775040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.775688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.775967 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.776269 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.776945 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.778923 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:36.872904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1445/2895] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:36 2022] POST /identity/v3/projects => generated 407 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:36.877467 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:36.888354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07369a7a-51b8-4bb2-9f9a-c904833ca1b3 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:36.945978 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:36.946590 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:36.946871 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:36.947145 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:36.947784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:36.949718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.043293 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1451/2896] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:36 2022] POST /identity/v3/users => generated 310 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:22:37.047336 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.058701 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcebed-3024-4df5-b97c-a4b23cd67744 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.063380 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.063975 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.064289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.064569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.065207 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.066795 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.078394 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1446/2897] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:37.082625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.095337 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467ac5-1ec4-4248-9d17-38f1b6029208 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.100813 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.101470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.101749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.102018 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] PATH_INFO: `/v3/projects/919bb944790f48ebb5fdcd3e3c25c425/users/3f9d789dde0145e1ada66613a79d1296/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.118747 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] RBAC: Authorizing `identity:create_grant(project_id=919bb944790f48ebb5fdcd3e3c25c425, user_id=3f9d789dde0145e1ada66613a79d1296, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.121465 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.209163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1452/2898] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:37 2022] PUT /identity/v3/projects/919bb944790f48ebb5fdcd3e3c25c425/users/3f9d789dde0145e1ada66613a79d1296/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:37.213478 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.224929 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b74b0-d81f-490b-834b-310241939c38 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.285212 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.286424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.286711 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.286984 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.287639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.289281 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e15b8-e268-4ad5-aa53-e7ffdfc38610 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.299998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1447/2899] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:37.304517 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.314932 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f265765-67d6-4b08-a8dc-11701c00b44e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.319660 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.320362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.320812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.321092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] PATH_INFO: `/v3/projects/919bb944790f48ebb5fdcd3e3c25c425/users/3f9d789dde0145e1ada66613a79d1296/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.323063 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919bb944790f48ebb5fdcd3e3c25c425, user_id=3f9d789dde0145e1ada66613a79d1296, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.325734 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.337208 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1453/2900] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:37 2022] PUT /identity/v3/projects/919bb944790f48ebb5fdcd3e3c25c425/users/3f9d789dde0145e1ada66613a79d1296/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:37.349450 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.349735 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.350009 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.369761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:37.378208 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] MFA Rules not processed for user `3f9d789dde0145e1ada66613a79d1296`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:37.379438 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:37.447265 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1448/2901] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:37.458560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.460436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:37.521787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da084e0-e66f-47a3-955b-4153f7458097 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.525861 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.526473 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.526755 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.527158 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.537424 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.539006 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.548797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1454/2902] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:37.897910 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:37.908120 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798636cb-6f98-4af4-bcda-fa7d3135e3d8 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:37.912491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:37.913106 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:37.913383 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:37.913656 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:37.971531 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:37.973002 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:37.983031 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1449/2903] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:44.325939 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:44.327565 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:44.383645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:44.459819 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55c5e1-7a9c-4613-bb92-e84ac6f663ae service cinder] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:44.466114 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:44.466740 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:44.467032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:44.467299 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:44.469095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:44.481797 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:44.483402 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca51b3-9abc-4b46-bd69-01d78a46b45d service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:44.494568 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1455/2904] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:45.950595 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:46.012300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e177ee-a0ea-4399-a52f-a72bafa532fe service cinder] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:46.016741 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:46.017366 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:46.017641 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:46.017912 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] PATH_INFO: `/v3/users/6ed86253ec3f47b9ad7de9a5261b80b0` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:46.019018 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed86253ec3f47b9ad7de9a5261b80b0)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:46.021584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:46.189688 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:46.199937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed86253ec3f47b9ad7de9a5261b80b0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:46.211786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed86253ec3f47b9ad7de9a5261b80b0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:46.212602 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed86253ec3f47b9ad7de9a5261b80b0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:46.219574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed86253ec3f47b9ad7de9a5261b80b0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:46.270624 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed86253ec3f47b9ad7de9a5261b80b0'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:46.276873 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1450/2905] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:45 2022] DELETE /identity/v3/users/6ed86253ec3f47b9ad7de9a5261b80b0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:46.281454 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:46.281952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:46.282095 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:46.301736 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:46.302973 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:46.361357 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1456/2906] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:46.372225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:46.373646 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:46.430740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f383fd9-492d-40ac-8396-c52b7ae7e5a4 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:46.434583 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:46.435181 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:46.435460 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:46.435738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:46.445282 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:46.446577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:46.455834 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1451/2907] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:46.855338 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:46.856887 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:46.869540 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974e95b-d56b-4688-9164-13e084d11f17 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:46.874309 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:46.875080 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:46.875368 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:46.875646 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] PATH_INFO: `/v3/projects/0b58d890a6ca499b96f5a9f442a1afe9` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:46.876818 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b58d890a6ca499b96f5a9f442a1afe9)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:46.878731 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:46.980181 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b58d890a6ca499b96f5a9f442a1afe9', 'request_id': 'req-dc92c901-6262-4256-b068-5a3c13b07ce2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.065146 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b58d890a6ca499b96f5a9f442a1afe9', 'request_id': 'req-dc92c901-6262-4256-b068-5a3c13b07ce2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.072169 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b58d890a6ca499b96f5a9f442a1afe9', 'request_id': 'req-dc92c901-6262-4256-b068-5a3c13b07ce2'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.083651 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] The token cache is being invalidate because project 0b58d890a6ca499b96f5a9f442a1afe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:47.083936 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.084623 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.086173 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1457/2908] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:46 2022] DELETE /identity/v3/projects/0b58d890a6ca499b96f5a9f442a1afe9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:47.090308 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:47.100306 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f8116-6414-4c11-8961-c41fcf8e50bc service neutron] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:47.158558 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:47.159188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:47.159513 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:47.159786 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] PATH_INFO: `/v3/users/3f9d789dde0145e1ada66613a79d1296` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:47.161016 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f9d789dde0145e1ada66613a79d1296)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:47.162953 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:47.376390 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f9d789dde0145e1ada66613a79d1296'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.383262 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:47.388495 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f9d789dde0145e1ada66613a79d1296'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.389180 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f9d789dde0145e1ada66613a79d1296'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.395875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f9d789dde0145e1ada66613a79d1296'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.476491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-a8f3158c-36ff-41ab-aa32-6e301e708153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f9d789dde0145e1ada66613a79d1296'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:47.483138 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1452/2909] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:47 2022] DELETE /identity/v3/users/3f9d789dde0145e1ada66613a79d1296 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:47.947100 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:47.949348 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:47.967886 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc92c901-6262-4256-b068-5a3c13b07ce2 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.000877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:48.037572 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.038223 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.038543 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.039168 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] PATH_INFO: `/v3/projects/919bb944790f48ebb5fdcd3e3c25c425` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.040898 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919bb944790f48ebb5fdcd3e3c25c425)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.042396 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.179692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919bb944790f48ebb5fdcd3e3c25c425', 'request_id': 'req-d9dcdc1e-6134-4660-a503-ba2d27e07554'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:48.258985 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919bb944790f48ebb5fdcd3e3c25c425', 'request_id': 'req-d9dcdc1e-6134-4660-a503-ba2d27e07554'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:48.272033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919bb944790f48ebb5fdcd3e3c25c425', 'request_id': 'req-d9dcdc1e-6134-4660-a503-ba2d27e07554'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:48.283695 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] The token cache is being invalidate because project 919bb944790f48ebb5fdcd3e3c25c425 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:48.283979 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:48.284657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d9dcdc1e-6134-4660-a503-ba2d27e07554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:48.286131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1458/2910] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:47 2022] DELETE /identity/v3/projects/919bb944790f48ebb5fdcd3e3c25c425 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:48.291185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.291665 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.291868 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.311472 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:48.312742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:48.373091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1453/2911] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:48.381478 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.381756 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.382029 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.402239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:48.403439 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:48.411245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1459/2912] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:48.415434 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.425671 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51449af5-c975-4de9-8863-6637ae2e17db None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.431540 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.432156 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.432487 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.432895 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.433692 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:48.434065 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.435926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.450244 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1454/2913] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:22:48.454948 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.465032 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e5ea3-fa6e-4574-ae98-a0d355dfee6e None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.469908 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.470504 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.470783 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.471055 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.471686 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.473647 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.638717 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1460/2914] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:48.642982 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.653081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630578ac-f856-4438-aef8-d67ff5ea0366 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.709781 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.710377 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.710650 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.710924 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.711658 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.713506 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.779499 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1455/2915] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:48 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:48.783589 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.794624 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a8a5-5c0c-4bf1-aa53-d60f5da5c88b admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.799279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.799872 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.800154 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.800460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.801101 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.803239 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.813177 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1461/2916] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:48.817326 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.827185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b948405-e8c0-40d7-aac7-90779438d47e admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.831662 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.832289 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.832571 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.832842 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.833479 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.835085 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adcc6c-a6ae-458f-8176-e0bd6f718eb8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.845410 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1456/2917] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:48.849930 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:48.859877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65236885-fd3d-4566-ba9f-fab13aed8b0d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:48.865553 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:48.866213 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.866614 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.866896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] PATH_INFO: `/v3/projects/a3bdec43965c44429a32fe195ca5c10e/users/c03be1506db94c3187adf2d4038cbd8d/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:48.881658 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3bdec43965c44429a32fe195ca5c10e, user_id=c03be1506db94c3187adf2d4038cbd8d, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:48.884350 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:48.962362 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1462/2918] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:48 2022] PUT /identity/v3/projects/a3bdec43965c44429a32fe195ca5c10e/users/c03be1506db94c3187adf2d4038cbd8d/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:48.972892 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:48.973729 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:48.973998 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.003802 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] MFA Rules not processed for user `c03be1506db94c3187adf2d4038cbd8d`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:49.005411 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:49.036893 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:49.075640 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1457/2919] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:49.090320 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:49.092087 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:49.155232 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d0e5c-3352-4181-834f-066cae5e9041 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:49.159268 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:49.159917 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:49.160248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:49.160529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.170225 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:49.171749 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafb4b7-cb3c-47f3-bae8-873ba92bed10 service cinder] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:49.175512 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:49.183189 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1463/2920] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:49.205374 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:49.268225 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9241-eee6-4cf7-9df5-79c019c2a96e None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:49.273669 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:49.274307 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:49.274591 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:49.274864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] PATH_INFO: `/v3/users/c03be1506db94c3187adf2d4038cbd8d` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.276036 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03be1506db94c3187adf2d4038cbd8d)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:49.278023 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:49.450598 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03be1506db94c3187adf2d4038cbd8d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:49.463286 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03be1506db94c3187adf2d4038cbd8d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:49.464001 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03be1506db94c3187adf2d4038cbd8d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:49.470940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03be1506db94c3187adf2d4038cbd8d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:49.556607 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03be1506db94c3187adf2d4038cbd8d'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:49.563007 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1458/2921] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:49 2022] DELETE /identity/v3/users/c03be1506db94c3187adf2d4038cbd8d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:22:49.568141 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:49.568533 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:49.568816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.588274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:49.589493 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:49.647770 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1464/2922] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:49.657961 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:49.659315 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:49.713267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:49.717041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a0bcc-c8f7-46bc-98ef-731a2f1fd081 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:49.720696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:49.721300 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:49.721577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:49.721845 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:49.731091 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:49.732536 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ae8a1-34d1-455f-bdf4-b0b4e6236bf9 service neutron] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:49.741989 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1459/2923] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:50.193528 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.196538 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:50.212459 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d85a4-c11e-4083-87a3-9469e684c80d None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.216954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.217603 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.217889 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.219132 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] PATH_INFO: `/v3/projects/a3bdec43965c44429a32fe195ca5c10e` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.219541 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3bdec43965c44429a32fe195ca5c10e)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.225604 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.341153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3bdec43965c44429a32fe195ca5c10e', 'request_id': 'req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:50.413787 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3bdec43965c44429a32fe195ca5c10e', 'request_id': 'req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:50.420134 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3bdec43965c44429a32fe195ca5c10e', 'request_id': 'req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:50.432462 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] The token cache is being invalidate because project a3bdec43965c44429a32fe195ca5c10e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:50.432753 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:50.433414 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-7d73f6cd-9285-4d4d-8dd4-c0819197a16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:50.434998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1465/2924] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:50 2022] DELETE /identity/v3/projects/a3bdec43965c44429a32fe195ca5c10e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:50.439831 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.440115 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.440417 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.459672 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:50.460928 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:50.521037 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1460/2925] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:50.528679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.528999 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.529279 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.549828 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:50.551066 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:50.559784 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1466/2926] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:50.564287 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.574267 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b1e0f-0ebc-414f-a5a2-857734936c72 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.579041 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.579637 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.579920 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.580188 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.580862 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:50.581163 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.582749 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.595275 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1461/2927] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:22:50.599788 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.609206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7839e9-d8ff-4aff-8f78-52b10cb9a5b6 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.615128 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.615885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.616163 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.616466 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.617097 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.618988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.741209 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1467/2928] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:50 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:50.745574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.755700 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b96f97-51ef-4509-9b6a-3e45116647f9 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.812587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.813191 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.813468 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.813738 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.814358 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.816273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.911666 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1462/2929] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:50 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:50.916002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.926518 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd098046-d764-491a-b63f-44a45956b245 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.931235 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.931833 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.932162 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.932486 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.933131 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.934713 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.944966 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1468/2930] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:50.949166 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.959584 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3d702-9e0d-43c0-884d-de6537d10e06 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.964177 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.964791 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.965069 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.965340 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:50.965972 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:50.967552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7119f5-a614-4d7b-a3a3-a60361027239 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:50.978696 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1463/2931] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:50.982815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:50.993085 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc27afe-ac3a-4447-9ba8-568565b2982d admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:50.997896 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:50.998546 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:50.998829 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:50.999118 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] PATH_INFO: `/v3/projects/9480c1ecb8ac42e7b7883184d81ec5d6/users/6454fc889d674f77938a28fc9dc1eae8/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.013771 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9480c1ecb8ac42e7b7883184d81ec5d6, user_id=6454fc889d674f77938a28fc9dc1eae8, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.016453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.083539 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1469/2932] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:50 2022] PUT /identity/v3/projects/9480c1ecb8ac42e7b7883184d81ec5d6/users/6454fc889d674f77938a28fc9dc1eae8/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:51.093956 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.094239 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.094514 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.122819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] MFA Rules not processed for user `6454fc889d674f77938a28fc9dc1eae8`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:51.124020 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:51.170175 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:51.189552 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1464/2933] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:51.194990 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.215138 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:51.257245 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489a423-fefa-41bd-9ba1-b3e276a3f5e4 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.261928 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.262531 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.262812 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.263092 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] PATH_INFO: `/v3/projects` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.264011 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.266481 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.364456 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1470/2934] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:51 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:51.368528 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.380089 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a821e-9452-44df-9926-c49a27c2da99 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.439000 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.439644 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.439941 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.440220 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] PATH_INFO: `/v3/users` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.440864 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.443361 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.517926 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1465/2935] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:51 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:51.522149 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.534089 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c1b03-ee89-45ea-a3d0-7c4c60b67495 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.538799 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.539433 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.539718 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.539998 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.540679 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.542354 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.555591 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1471/2936] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:51.560060 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.571548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f787d-ef4f-4171-84ff-b2634286bc84 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.576709 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.577386 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.577719 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.577997 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] PATH_INFO: `/v3/projects/7dc6dfa713f6430891c5d02152b7541b/users/8dab3e0e2db84a888714e353266aeb0a/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.593789 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc6dfa713f6430891c5d02152b7541b, user_id=8dab3e0e2db84a888714e353266aeb0a, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.596477 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.665486 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1466/2937] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:51 2022] PUT /identity/v3/projects/7dc6dfa713f6430891c5d02152b7541b/users/8dab3e0e2db84a888714e353266aeb0a/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:51.669714 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.681336 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e62a2-5bbb-4c93-8f30-1e4f6dd496ba admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.741815 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.742343 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.742625 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.742904 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.743555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.745200 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85498591-5087-47ac-96ea-3cc66bfdbcb8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.756042 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1472/2938] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:51.760563 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.771505 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab9970-a2aa-4d9e-a096-c7f74624f44b admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:51.776167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:51.776875 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.777151 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.777422 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] PATH_INFO: `/v3/projects/7dc6dfa713f6430891c5d02152b7541b/users/8dab3e0e2db84a888714e353266aeb0a/roles/ccb1014ef84043b3899f8951beb10ad7` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.779320 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc6dfa713f6430891c5d02152b7541b, user_id=8dab3e0e2db84a888714e353266aeb0a, role_id=ccb1014ef84043b3899f8951beb10ad7)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:51.781986 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:51.793171 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1467/2939] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:51 2022] PUT /identity/v3/projects/7dc6dfa713f6430891c5d02152b7541b/users/8dab3e0e2db84a888714e353266aeb0a/roles/ccb1014ef84043b3899f8951beb10ad7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:51.805272 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:51.805559 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:51.805836 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:51.834657 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] MFA Rules not processed for user `8dab3e0e2db84a888714e353266aeb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:51.835894 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:51.907483 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1473/2940] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:51.919697 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:51.921457 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:51.999663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f48a-60f3-401f-b134-29362c6e2abd admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:52.005785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:52.006819 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:52.007319 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:52.007816 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:52.070313 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:52.074127 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:52.075617 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee71e3-0d0a-4595-aae5-98743bda7746 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:52.085268 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1468/2941] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:55.203206 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:55.216761 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:55.267859 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1a38c-a63b-4b8b-9e94-11ccd60b1f08 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:55.272371 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:55.273002 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:55.273280 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:55.273555 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] PATH_INFO: `/v3/users/6454fc889d674f77938a28fc9dc1eae8` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:55.274674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6454fc889d674f77938a28fc9dc1eae8)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:55.276636 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:55.404645 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6454fc889d674f77938a28fc9dc1eae8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:55.488515 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6454fc889d674f77938a28fc9dc1eae8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:55.501867 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6454fc889d674f77938a28fc9dc1eae8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:55.502510 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6454fc889d674f77938a28fc9dc1eae8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:55.510537 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6454fc889d674f77938a28fc9dc1eae8'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:55.516606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1474/2942] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:55 2022] DELETE /identity/v3/users/6454fc889d674f77938a28fc9dc1eae8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:55.521153 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:55.521710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:55.521710 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:55.541446 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:55.542663 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:55.602217 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1469/2943] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:55.612033 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:55.613460 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:55.670913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee3010-33e6-4e3e-8a95-7a1dbec9b83e admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:55.674435 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:55.675034 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:55.675313 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:55.675617 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:55.685094 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:55.686492 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:55.696363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1475/2944] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:22:56.090081 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:56.091548 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:56.106409 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679aae-fd9a-46ea-827c-885c081cdf0f None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:56.111491 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:56.112251 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:56.112587 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:56.112818 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] PATH_INFO: `/v3/projects/9480c1ecb8ac42e7b7883184d81ec5d6` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:56.114098 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9480c1ecb8ac42e7b7883184d81ec5d6)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:56.125776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:56.270784 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9480c1ecb8ac42e7b7883184d81ec5d6', 'request_id': 'req-f55fcd63-2704-4f63-8b53-ab1b564a9363'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.278185 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9480c1ecb8ac42e7b7883184d81ec5d6', 'request_id': 'req-f55fcd63-2704-4f63-8b53-ab1b564a9363'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.284082 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9480c1ecb8ac42e7b7883184d81ec5d6', 'request_id': 'req-f55fcd63-2704-4f63-8b53-ab1b564a9363'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.350464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] The token cache is being invalidate because project 9480c1ecb8ac42e7b7883184d81ec5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:56.350723 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.351285 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.352833 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1470/2945] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:56 2022] DELETE /identity/v3/projects/9480c1ecb8ac42e7b7883184d81ec5d6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:56.356933 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:56.366969 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fc0e-169d-42b4-928b-33a5e3664198 service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:56.400140 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:56.425856 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:56.426633 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:56.426913 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:56.427248 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] PATH_INFO: `/v3/users/8dab3e0e2db84a888714e353266aeb0a` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:56.428415 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dab3e0e2db84a888714e353266aeb0a)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:56.430388 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:56.651895 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dab3e0e2db84a888714e353266aeb0a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.728214 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dab3e0e2db84a888714e353266aeb0a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.742748 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dab3e0e2db84a888714e353266aeb0a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.743477 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dab3e0e2db84a888714e353266aeb0a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.750844 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-d5971f22-d867-4c03-a395-b8fb43a67abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dab3e0e2db84a888714e353266aeb0a'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:56.757529 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1476/2946] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:22:56 2022] DELETE /identity/v3/users/8dab3e0e2db84a888714e353266aeb0a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:57.141423 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.142937 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:57.157424 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fcd63-2704-4f63-8b53-ab1b564a9363 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.216105 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.216761 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.217043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.217309 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] PATH_INFO: `/v3/projects/7dc6dfa713f6430891c5d02152b7541b` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.218414 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc6dfa713f6430891c5d02152b7541b)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.220376 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:57.242448 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:57.353431 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc6dfa713f6430891c5d02152b7541b', 'request_id': 'req-18d0a60f-38ad-40bb-afba-702bcae69903'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:57.361062 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc6dfa713f6430891c5d02152b7541b', 'request_id': 'req-18d0a60f-38ad-40bb-afba-702bcae69903'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:57.367914 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc6dfa713f6430891c5d02152b7541b', 'request_id': 'req-18d0a60f-38ad-40bb-afba-702bcae69903'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:57.471092 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] The token cache is being invalidate because project 7dc6dfa713f6430891c5d02152b7541b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:22:57.471327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:57.471905 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-18d0a60f-38ad-40bb-afba-702bcae69903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:22:57.474040 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1471/2947] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:22:57 2022] DELETE /identity/v3/projects/7dc6dfa713f6430891c5d02152b7541b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:57.478954 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.479444 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.479549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.500800 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:57.502013 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:57.563876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1477/2948] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:57.571828 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.572137 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.572464 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.592856 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:57.594056 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:57.602574 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1472/2949] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:57.606876 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.617249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb9dba-cd6f-406f-99e0-de214dff0d32 None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.621977 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.622641 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.622914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.623351 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] PATH_INFO: `/v3/domains` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.624004 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:22:57.624345 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.625988 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:57.637885 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1478/2950] 10.222.0.96 () {58 vars in 1153 bytes} [Thu Sep 8 14:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:22:57.642721 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.652742 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f6d0b-7caf-4607-90ab-56951b8b5705 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.657443 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.658045 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.658329 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.658647 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] PATH_INFO: `/v3/projects` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.659248 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.661850 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:57.741167 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1473/2951] 10.222.0.96 () {60 vars in 1153 bytes} [Thu Sep 8 14:22:57 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:57.745470 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.756021 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194708c-21a1-485d-a1c2-01abe3842819 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.796838 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:57.812914 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.813519 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.819003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.819003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.819003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.819003 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:57.939498 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1479/2952] 10.222.0.96 () {60 vars in 1144 bytes} [Thu Sep 8 14:22:57 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:22:57.943768 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.954195 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9ef78-19e6-4f06-b1a6-a4fc2235f392 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.958904 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.959502 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.959785 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.960059 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.960740 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.962335 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:57.972341 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1474/2953] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:22:57.976974 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:57.987269 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b441e-9673-4eb1-a411-411f2f70a2f8 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:57.993431 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:57.994043 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:57.994331 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:57.994611 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:57.995287 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:57.996916 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0a008-d846-4749-b2ac-2f700a96cca3 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:58.009170 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1480/2954] 10.222.0.96 () {58 vars in 1122 bytes} [Thu Sep 8 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:22:58.013497 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:58.023776 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a1149-3283-4b38-b3ae-b7428b0e16c8 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:58.028406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:58.033691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:58.033691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:58.033691 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] PATH_INFO: `/v3/projects/e2eca6da9ac544bca7f37e68e303b6a2/users/b63bd6601f6f4aec922d9a2a115504f6/roles/fd19870371784c8facf151d36c77a6b5` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:58.044826 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2eca6da9ac544bca7f37e68e303b6a2, user_id=b63bd6601f6f4aec922d9a2a115504f6, role_id=fd19870371784c8facf151d36c77a6b5)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:58.047462 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:58.118187 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1475/2955] 10.222.0.96 () {60 vars in 1483 bytes} [Thu Sep 8 14:22:58 2022] PUT /identity/v3/projects/e2eca6da9ac544bca7f37e68e303b6a2/users/b63bd6601f6f4aec922d9a2a115504f6/roles/fd19870371784c8facf151d36c77a6b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:22:58.128944 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] REQUEST_METHOD: `POST` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:58.129453 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:58.129816 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:58.158461 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.auth.core [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] MFA Rules not processed for user `b63bd6601f6f4aec922d9a2a115504f6`. Rule list: `[]` (Enabled: `True`). {{(pid=93408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:22:58.159674 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:58.226000 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1481/2956] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:22:58.237569 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:22:58.239298 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:22:58.296588 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12217cf8-cfc7-4e88-a72f-9883fb8b5b73 admin admin] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:22:58.300193 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c27a70df04007aca38511444d9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:22:58.300821 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:22:58.301100 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:22:58.301406 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:22:58.309541 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:22:58.311121 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff3a50-8078-4967-96cd-be9f6d3b9ea4 service cinder] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:22:58.319639 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1476/2957] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:23:02.591391 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:23:02.654810 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b690-c2e0-41f2-b713-46d0e17902ae None None] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:23:02.659445 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:23:02.660081 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:23:02.660421 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:23:02.661274 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] PATH_INFO: `/v3/users/b63bd6601f6f4aec922d9a2a115504f6` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:23:02.662406 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63bd6601f6f4aec922d9a2a115504f6)` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:23:02.664401 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:23:02.873480 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63bd6601f6f4aec922d9a2a115504f6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:02.877193 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:02.979196 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63bd6601f6f4aec922d9a2a115504f6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:02.992737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63bd6601f6f4aec922d9a2a115504f6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:02.993549 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63bd6601f6f4aec922d9a2a115504f6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.001249 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.notifications [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63bd6601f6f4aec922d9a2a115504f6'} {{(pid=93408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.007737 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1482/2958] 10.222.0.96 () {58 vars in 1224 bytes} [Thu Sep 8 14:23:02 2022] DELETE /identity/v3/users/b63bd6601f6f4aec922d9a2a115504f6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:23:03.012442 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] REQUEST_METHOD: `POST` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:23:03.014577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:23:03.014577 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:23:03.032841 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.auth.core [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] MFA Rules not processed for user `1dee14b5375a4327b3046a21c8c67366`. Rule list: `[]` (Enabled: `True`). {{(pid=93409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:23:03.034055 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:23:03.075946 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:03.093327 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1477/2959] 10.222.0.96 () {58 vars in 958 bytes} [Thu Sep 8 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:23:03.103190 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:23:03.104780 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:23:03.163363 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e22fa5-21b5-43be-8593-06527535cc21 admin admin] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:23:03.167228 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ecb77c3d0b4b06a94562fe8da25ec5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:23:03.167839 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:23:03.168127 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:23:03.168436 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:23:03.177877 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:23:03.179306 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:23:03.188952 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1483/2960] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:23:03.621949 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] Authenticating user token {{(pid=93409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:23:03.623370 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.fernet_utils [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:23:03.637273 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb63c5e-0440-4a26-8efa-86b179fda4d3 None None] Validating token access rules against request {{(pid=93409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:23:03.642940 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1dee14b5375a4327b3046a21c8c67366', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f9a4c439d9e4fb8b5b20ab81fd61ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:23:03.643582 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:23:03.643872 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:23:03.644148 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] PATH_INFO: `/v3/projects/e2eca6da9ac544bca7f37e68e303b6a2` {{(pid=93409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:23:03.645384 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2eca6da9ac544bca7f37e68e303b6a2)` {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:23:03.647365 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] RBAC: Authorization granted {{(pid=93409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:23:03.763527 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2eca6da9ac544bca7f37e68e303b6a2', 'request_id': 'req-1f2094ec-f845-454e-9291-3d1353d49b4e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.771043 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2eca6da9ac544bca7f37e68e303b6a2', 'request_id': 'req-1f2094ec-f845-454e-9291-3d1353d49b4e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.776708 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2eca6da9ac544bca7f37e68e303b6a2', 'request_id': 'req-1f2094ec-f845-454e-9291-3d1353d49b4e'} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.847792 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] The token cache is being invalidate because project e2eca6da9ac544bca7f37e68e303b6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:23:03.848716 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.849354 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG keystone.notifications [None req-1f2094ec-f845-454e-9291-3d1353d49b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:23:03.850838 dv-cinder-847733-4-smb devstack@keystone.service[93409]: [pid: 93409|app: 0|req: 1478/2961] 10.222.0.96 () {58 vars in 1233 bytes} [Thu Sep 8 14:23:03 2022] DELETE /identity/v3/projects/e2eca6da9ac544bca7f37e68e303b6a2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:23:13.184732 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=38,keystone:DELETE=2 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:13.844551 dv-cinder-847733-4-smb devstack@keystone.service[93409]: DEBUG dbcounter [-] [93409] Writing DB stats keystone:SELECT=33,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:52.296432 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] Authenticating user token {{(pid=93408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:27:52.297848 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:27:52.367606 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543916b-7814-4ac3-b523-b8c601384d4a service neutron] Validating token access rules against request {{(pid=93408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:27:52.427560 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a34d9681ab04766a822de8737a227e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '37dfa5b58abe4cf397ec97b79a4ea73b', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:27:52.428153 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] REQUEST_METHOD: `GET` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:27:52.428463 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] SCRIPT_NAME: `/identity` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:27:52.428744 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:27:52.430452 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.fernet_utils [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:27:52.441724 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:27:52.443266 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a98e3-1d94-4d3d-9633-f8d519b5386e service placement] RBAC: Authorization granted {{(pid=93408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:27:52.453692 dv-cinder-847733-4-smb devstack@keystone.service[93408]: [pid: 93408|app: 0|req: 1484/2962] 10.222.0.96 () {60 vars in 1365 bytes} [Thu Sep 8 14:27:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:28:02.448837 dv-cinder-847733-4-smb devstack@keystone.service[93408]: DEBUG dbcounter [-] [93408] Writing DB stats keystone:SELECT=58 {{(pid=93408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}